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e) said intensity of fear is determined by said intensity of stimulus of an object, a situation or an activity; 

f) said intensity of envy of a real or virtual human, Pm, at a success or a property of a real or virtual human, PI, is 
determined by: (i) intensities of satisfactions (bef(Pm,b,i) in the Description) and desires {des(Pm,b,t) in the 
Description) of said Pm, with respect to need b, for each need b connected with said success or property of PI, 
(ii) intensities of satisfactions of said PI, which are too great according to said Pm, with respect to said needs b. 

Claim 3 (amended). What is claimed is: 

Said, in Claim 1 (b), method for determining intensities of emotions: (i) contentment, joy, happiness, dissatisfaction, 
annoyance, anger, grief, pain and suffering, with respect to a need b, (ii) frustration, depression, sadness and shame; 
comprising: 

a) said intensities of contentment, joy, happiness, dissatisfaction, annoyance, anger, grief, pain and suffering, with 
respect to a need b, at time /, of said (in Claim 2) Pd, are given by function values (zful(Pd,b,t), in the Descrip- 
tion) which are determined by: (i) said, in Claim 2, intensities of satisfaction and desire, with respect to said need 
b, perceived by said Pd, (ii) said, in Claim 2, stimulus patterns, with respect to said need b, which occur in 
descriptions (models) of objects, situations or activities, or which are associated with a goal; 

b) said intensities of frustration and depression of said Pd are determined by said function values ( zful(Pd,b,t), in 
the Description); 

c) said intensity of sadness of said Pd is determined by: (i) said function values (zful(Pd,b,t), in the Description); 
(ii) said, in Claim 2, intensities of stimuli of objects, situations or activities; (iii) stimulus patterns associated with 
goals; 

d) said intensity of shame of said Pd is determined by said function values, with respect to the need, AN, for 
recognition, acknowledgment and self-esteem" (zful(Pd,AN,t), in the Description). 

Claim 4 (amended). What is claimed is: 

Said, in Claim 1 (c), method for determining intensities of positive emotions (liking, affection, love) and negative 
emotions (dislike, aversion, anger, hate, desire for retaliation and revenge, jealousy) to/for/of OSA, where OSA 
denotes an object, a situation or an activity; comprising: 

a) said intensity of positive emotions of said (in Claim 2) Pd to/for said OSA, at time /, is given by first function 
values (zulieb(Pd,OSA,t), in the Description); said intensities of dislike, annoyance, aversion and anger of said 
(in Claim 2) Pd to/for said OSA, at time t, are given by second function values (abhas(Pd,OSA,t), in the 
Description); said first and second function values (zulieb(Pd,OSA,t) and abhas(Pd,OSA,t) in the Description) are 
determined by: (i) perceived said (in Claim 2) intensities of satisfactions and desires, with respect to need A; (ii) 
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said, in Claim 2, stimulus patterns with respect to need b, which occur in said OSA or are connected with a goal; 
60 b) said intensity of desire for retaliation and revenge of said (in Claim 2) Pd on an object, Ob, is determined by 
changes of: (i) said intensity of dislike, annoyance, aversion and anger of said Pd to/for said object Ob 
(abhas(Pd,Ob,t), in the Description); (ii) said intensity of positive emotions of said Pd to/for said object Ob 
(zulieb(Pd, Ob, t), in the Description); 

c) said intensity of hate of said Pd to an object, Ob, is determined by; (i) said intensity of disUke, annoyance, 

65 aversion and anger of said Pd to/for said object Ob (abhas(Pd,Ob,t), in the Description); (ii) said intensity of 
desire for retaliation and revenge of said Pd on said object Ob; 

d) said intensity of jealousy of said Pd of an object, Of, because of kind feeling or love of an Pdl towards said 
object Of (where Pdl denotes a human, a mammal, a virtual human or mammal in a software system, or an agent 
system), is determined by intensities of positive emotions of: said Pd towards said Pdl, said Pdl towards said Of. 

70 Claim 5 (amended). What is claimed is: 

Said, in Claim 1 (d), method for determining the intensity of feeling guilt, comprising: 

a) said intensity of feeling guilt of said (in Claim 2) Pd, with regard to an object PO, is determined by: (i) decrease 
of said, in Claim 2, intensities of satisfactions of said object PO with respect to some needs b (decrease of 
bef(PO,b,t), in the Description); (ii) decrease of said, in Claim 3, intensity of contentment, joy, happiness, 

75 dissatisfaction, annoyance, anger, grief, pain and suffering of said Pd, with respect to the need (AN) for 

recognition, acknowledgment and self-esteem' (decrease of zful(Pd,AN,t), in the Description); (iii) said, in Claim 
4, intensities of positive emotions (liking, affection, love) and negative emotions (dislike, annoyance, aversion, 

78 anger) of said Pd to/for said object PO (mlieb(Pd,PO,t) and abhas(Pd,PO,t), respectively - in the Description). 
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7.1. Envy 

A success or a property of a human, PI, can be the envy of another human, Pm. A success of PI means an 
800 increase of bef(Pl,bl,.) for at least one bl. A property of PI arises envy of Pm when Pm thinks that bef(Pl,b2,.) 
should be smaller, where b2 is associated with this property. Thus, we may define envy more precisely as follows: A 
human Pm envies human PI his/her success or property, at time ta, when Pm believes that: 

* bfm(Pl, b, ta) > cn(b) + bef(Pm, b, ta), for at least one be Bd(Pm), where Pm thinks that the value beffPl, b, ta) 
equals bfm(Pl,b,ta) and cn(b) > 0; 

805 * Pm thinks that PI has no right to such great value bfm(Pl,b,ta); 

* des(Pm,b,ta) > 2. 

With this envy of Pm is connected the following need of Pm: 

bnd(b) - PI should have such value bfin(Pl,b,t) that bfm(PUb,t) < cn(b) + bef(Pm,b,t), for / > ta. The intensity of 
the envy of Pm at the value bfm(Pl,b,ta) is described by bef(Pm,bnd(b),ta) and des(Pm,bnd(b),ta) as follows: 
810 bef(Pm,bnd(b),ta) = min(18, max(-18, (bef(Pm,b,ta) + cn(b) - bfm(Pl,b,ta))*sqrt(des(Pm,b,ta)) /c2 +6)), 

des(Pm,bnd(b),ta) = min(50, max(0, chI*(bfm(Pl,b,ta) - cn(b) - bef(Pm,b,ta))* sqrt(des(Pm,b,ta)) /c2) ), 
where 1 <chl< 2, 1.5 < c2 < 5 (sugg. : chl = 1.4, c2 = 2.5). 
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7.1. Envy 

A success or a property of a human, PI, can be the envy of another human. Pm. A success of PI means an 
soo increase of bef(Pl,bl,.) for at least one bl. A property of PI arises envy of Pm when Pm thinks that bef(Pl,b2,.) 
should be smaller, where b2 is associated with this property. Thus, we may define envy more precisely as follows: A 
human Pm envies human PI his/her success or property, at time ta, when Pm believes that: 

* bfm(Pl,b,ta) > cn(b) + bef(Pm,b,ta), for at least one be Bd(Pm), where Pm thinks that the value bef(Pl,b,ta) 
equals bfin(P 1 ,b,ta) and cn(b) > 0; 

805 * Pm thinks that PI has no right to such great value bfm(PJ,b,ta); 

* des{Pm^bjal>2. 

With this envy of Pm is connected the following need of Pm: 

bnd(b) - PI should have such value bfm(Pl,b,t) that bfm(Pl,b,t) < cn(b) + bef(Pm,b,t), for / > ta. The intensity of 
the envy of Pm at the value bfm(Pl,b,ta) is described by bef(Pm,bnd(b),ta) and des(Pm,bnd(b),ta) as follows: 
810 bef(Pm,bnd(b),ta) = mm(l8, mS£c&J8Jbef(Pm,b,ta) + cn(b) - bfm(P 1 Xta)}^sm(^§[Pm x bMXJ^ 

des(Pm,bnd(b),ta) = m in(5g^max(0, chl *(bfm(Pl,b,ta) - cn(b) - bef(Pm,bja))^sgri{desj3>^ 
where KchK 2, L^<c2<JJs^E&- chl = 1.4, c2^2S). 
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Description 

Representation of Emotions in Electronic Devices 
Schurmann Alfred 

1. Introduction 

Computer scientist are concerned with representation of emotions in electronic devices since several years. 1 
know the following papers (patents) which concern the representation of emotions in electronic devices. Padgham 
& Taylor [PTA] (1997), Breese & Ball [BRD] (1999), Brush & at all [BDL] (1998), Clynes [CLY] (1996), 
Kawamoto & Omura [KAO] (1994), Knight & at all [KMS] (1997), Skelly [SKE] (2000), Tow [TOW] (2000). 
In these papers, emotions are modelled in other way than below and not sufficient. The representation of emotions 
given in this description is based on notions (desires and satisfaction, stimuli) introduced in my papers [AS1] (1998) 
and [AS2] (1998). The representation of emotion states, given below, enables very good simulation of emotions: 

a) In Internet and entertainment software - one may represent virtual people who behave emotional, according to 
the changing surrounding, and understand emotions of other virtual people, e.g. a virtual man in Internet who 
expresses emotions when he shows ware. 

b) In agent systems which handle and communicate with people. Such agent system could not only express emotions 
according to actual situations but also understand emotions of people in surroundings of the agent system 

These applications can be made if also other problems are solved, e.g. perception which can identify emotions, 
connection of behaviors with emotion states. 

In this paper, the following stimulus and emotion states are formal described: 

- the stimuli of OSA, where OSA denotes an object, a situation or an activity; 

- contentment, joy, happiness, dissatisfaction, annoyance, anger, grief, sadness, pain and suffering; 

- positive feelings (liking, affection, love) and negative feelings (dislike, anger) to/for OSA, 

- satisfaction and joy when a goal (goal situation) is achieved; dissatisfaction, anger and disappointment when a goal 
situation is not achieved; 

- retaliation and revenge on an object, hate to an object; 

- frustration, depression, sadness, envy, jealousy, shame and feeling guilt 

2. Representation of Desires and Patterns of Stimuli 
2.1. Desire and Satisfaction 

In this description, Pd denotes a human, a mammal, a virtual human or mammal in a software system, or an 
agent system which simulates emotions. Pd has a set Bd(Pd) of needs. For a person P, Bd(P) contains the following 
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primary needs: SJV - for tasty food, EN - for relaxation, LU - to breathe, - for bodily activities, LE - to be alive, 
GE - to be healthy, KS - to have no pain, GR - to belong to a community, NU - to be in normal environment with 
regard to temperature, smell, light, humidity, space and acoustics, SH - for visual beauty, LI - to be loved, BN - to 
take care over own children, MA - to have power over people or animals, SE - for sexual relations, AN - for reco- 
35 gnition, acknowledgment and self-esteem, NE - curiosity and the need for identification, MU - for music. A human 
has also secondary needs, for example: bvr(Pl) - need for revenge on person PJ, bsz(Sz) - need to achieve goal 
situation Sz. An agent system (e.g. an artificial servant) may have the following needs: GR - to belong to a commu- 
nity, ES - for (electric) energy, NG - not to act against members of the community to which the agent belongs. 
We describe the state of tension (desire) and satisfaction (relief) of a need b of Pd, at time t, by two functions: 
40 0<des(Pd,b,t)<60, -30 <bef(Pd,b,t) <30, for b in Bd(Pd) 

where des(Pd,b,t) is the value (the intensity) of desire of need * and bef(Pd,b,t) is the value (the intensity) of 
satisfaction or dissatisfaction of need b, at time t. These functions have the following properties: 
i. Increasing function bef(Pd,b,t) means Pd is satisfying his need b (positive stimulus) and is perceived by Pd with 
approval, pleasure, joy or happiness. 
45 ii. When bef(Pd,b,0 < 0 and does not increase then Pd perceives bef(Pd,b,t) as a negative stimulus with disappoint- 
ment, disapproval, annoyance, anger, sadness or suffering, with regard to need b. Decreasing bef(Pctb,t) < 0 
means stronger negative stimulus with regard to b. 
iii. If bef(Pd,b,t) < 0 then des(Pd,b,t) > 0.1. When bef(Pd,b,t) < 0 and decreases then des(Pd,b,t) increases. 
bef(Pd,b,t) and des(Pd,b,t) can increase at the same time, for some needs b. 
50 iv. des(Pd, b, t) is the intensity of the desire of Pd to satisfy the need b at time t. The greater des(Pd, b, t) the greater is 
the desire of Pd to satisfy the need b. des(Pd,b,t) < 0.5 means the need b of Pdis well satisfied at time t\ 
v. The greater des(Pd,b,t), the greater is the approval and joy of Pd when bef(Pd,b,t) increases, and the greater is 

the dissatisfaction, the anger and the grief of Pd when bef(Pd,b,t) < 0 and decreases. 
Example 2.0. vP is a virtual person in an entertainment software. It simulates the eating behavior of a man and 
55 takes three meals a day. vP had breakfast before 8.00. It has lunch in the time 1.00 - 1.30 pm. The functions 
bef(vP,SN,t) and des(vP,SN,t) for that case are shown below 

\ /= 8.0 8.3 9.0 9.3 10.0 10.3 11.0 11.3 12.0 12.3 1.0 1.05 1.10 1.15 1.20 1.25 1.30 
bef(vP,SN,t) 4 3.5 2.9 2.3 1.6 0.9 0.2 -I -1.9 -2.8 -3.6 -3 -2.3 -0.9 0.5 2 3.7 
des(vP,SN,t) 1 1.4 1.9 2.3 2.9 3.5 4.1 4.8 5.6 6.6 7.7 7.1 6 4.8 3.7 2.4 1.3 
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60 2.2. Representation of Stimuli 

We assume that /W has models of objects and situations of his environment. Pd has also models (or schemes) 
of activities (behaviors, operations, procedures) which he/she can execute. When Pd perceives a new object, On, or 
a situation, Sn, then Pd creates a model for On or Sn. In the process of perception of actual objects, situations and 
activities (before their execution) Pd builds inner representations of these objects, situations and activities by the 

65 mentioned models. In this description, by an object, a situation or activity, OSA, we mean this inner representation 
of a real object, a real situation or a real activity. These inner representations have the same structures as the models 
of objects, situations or activities. Therefore, OSA denotes also the model of an object, a situation or an activity. 

In OSA, stimuli are represented by values of functions bef(Pd,b,t) and des(Pd,b,t) as follows (the stimulus 
patterns given in Schurmann [AS1] and [AS2] are not sufficient): 

70 (ds'; ([" I (Nba,Nb),}fs(Pd,b) = f[° \p;] n; (yl,zl),...,(yn,zn); qht) [° | /[° | z] eu] [° |; OSAJ.Ej] [° |; where C]); ...) 
where [lexl \ ... | texk] denotes one of the words texl,...,texk, ° denotes the empty word, Nba, Na, n are natural 
numbers, Nba < Nb, 1< n <10,fs denotes one of the patterns defined below, 0<p<l, -30 <yi < 30, -55 < zi < 60, 
yi and zi are simple arithmetical expressions, q hi denotes a period of time (e.g. 20 min, 0.5 h, 4 h, 3 days, J week), 
n*qht< 720 h, z> 0, eu denotes a measure (e.g. kg, g, h, km, m, I) and e g. /200 g denotes pro 200 g. 

75 ((Nbajyfb), fs(Pd,b) = ...) means that the property fs(Pd, b) = ... holds Nba times per Nb applications (perceptions) of 
OSA by Pd Nba/Nb is interpreted by Pd as the probability that the property fs(Pd,b) = . . holds. Example 
(80,120), fs(Pd,b) - (...) in a situation S means: when Pd perceives this situation then he/she experts that bef(Pd,b,.) 
and des(Pd,b,.) alter, with probability 80/120 = 2/3, as given by fs(Pd,b) =.... C is a condition If C occurs then the 
pattern fs(Pd,b) = .... may be applied only if C is true. IfOSAl.Ej occurs then the pattern fs(Pd,b) = ... in OSA is 

80 connected with the pattern Ej = (ds .... fse(Pd, b) = (...)...) in OSA 1. 

Now we define the patterns denoted by fs. We assume that ds property fs(Pd,b) = ... occurs in OSA. 
fs = epb epb(Pd,b) = (n; (yl,zl),...,(yn,zn); q hi) [° | /[° | z] eu] 

where yn > 1+yl and zl > /+ zn. The Meaning: Case: OSA is an object or a situation. Pd can execute (time td) an 
activity, A V, such that when Pd uses OSA inAV then Pd expects that OSA will alter bef(Pd, b, t) and des(Pd, b, t) as 

85 given in (1). Case: OSA is an activity. When Pd executes OSA correctly then Pd expects the following function 
values- 

bef(Pd,b,ta+(i-l)*q hi) = yi + dby, if yi > bef(Pd,b,ta) 
= yi, if yl < be/(Pd,b,ia) <yi 
(1) = bef(Pd,b,ta), if yl < bef(Pd,b,ta) >yi 
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des(Pd,b,ta+(i-l) *q ht) - zi + dbz, if des(Pd,b,ta) > zl 
= zi, if zi '< des(Pd,b,ta) < zl 

= des(Pd,b,ta), if z7 > des(Pd,b,ta) < zi, for / =l,...,n, 
where c% = bef(Pd,b,ia) -yl (< 0). dbz = des(Pd,b,ta) - zl (> 0) and j>2-j>7 + ...+>w-.y7 > 0. Below, in7W7 and 
P/-72, is given more exactly how we apply these formulae: 

Prll : Case: neither Vz eu * nor 7 eu ' occurs in epb, where '/eu * means 71 eu . In the following we write beffb, l) and 
des(b,t) instead of bef(Pd,b,t) and des(Pd,b,t). 

if bef(b,ia) >yl then begin for / := 2 to « do bef(b,ta+(i-l)*q ht) :- max(yi,bef(b,ta)); tl :- ta end 
else begin tl := ta, 
while ^7 > bef(b,tl) do begin dby :~ bef(b,tl) -yl; 

for i ~ 2 to n do bef(b,tl+(i-l) *q ht) ~yi +• c/Ay; f7 := f7 +(n-l)*q ht end; 
/77 := /7; / := 2; 

while < bef(b,tl) a / < « do begin / ~ i+1; til ™ *77 - 7 end; 
if / < « then for y:= / to « do bef(b,tl l+Q-l) *q ht) ~ yj; 
tl := f77 end. 

if des(b, ta) < zl then begin for i i := 2 to n do ta+(i-l) *q ht) ~ min(zi,des(b, ta)); t2 ta end 
else begin t2 := to; 

while z7 < des(b,ta) do begin d&z := des(b,t2) - zl, 

for / = 2 to n do rfesfS, t2+(i-l) *q ht) ~zi + dbz; t2 := t2 +(n-l) *q ht end; 

/27 ~ t2; i := 2; 
while z/ > des(b,t2) a / < w do begin i := 1+7; /27 := /27 - 7 end; 

if / < n then for y:= / to n do des(b,t21+0~O *1 ht) := z/; 

*2 := f27 end. 

Pr72: Case: 7z ew" or '/ ew ' occurs in epb and P</ uses k*z eu (units) of OSA. 

if beffb.ta) >yl then begin for i := 2 to n do bef(b,ta+(i-l)*q ht) ~ max(yi,bef(b,ta)); tl ~ ta end 
else begin /7 := to; a := 7; 
while yl > bef(b,tl) a m < k do begin rfAy := bef(b,tl) -yl, 

for I := 2 to » do bef(b,tl+(i-l) *q ht) =yi + dby; tl ~ tl +(n-l) *q ht; u := u+1 end; 
if « > * then tl :- tl - (n-l)*q ht else begin r77 := tl; i := 2; 
while < beffb.tl) a /' < /i do begin / :~ /+7; /77 := /77 - 7 end; 
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120 if /<« then for/ := j ton do bef(b,tl 1+0-1) *qht) ~yj, 

tl := til end end. 

if des(b,ta) < zl then begin for / := 2 to w do des(b,1a+(i-l)*q ht) := min(zi,des(b,ta)); t2 := to end 
else begin £2 := fa; m := 7; 
while z7 < des(b,ta) a m < A do begin d&z := des(b,t2) - zl, 
125 for ; := 2 to « do desf&, t2+(i-l) *q ht) := z/ + <#>z; *2 := t2 +(n-l) *q ht; u ~u+l end; 

if u > k then /2 := /2 - (n-1) *q ht else begin t21 ~ t2; i := 2; 
while 2/ > de$(b,t2) a / < » do begin ? := /+/; t21 := /27 - 1 end; 
if / < n then for y := i to w do des(b,t2I+(j-l) *q ht) ~ zj; 
t2 := /27 end end 

130 Example 2.1. Agent system, Ap, has in his model, M(Lfg), of the dish 0.3 kg salmon with fresh potatoes and 
vegetable' the following property 

(ds\(epb(P,SN) = (4; (-5,10),(-2, 7),(1,4),(4.5,0.5); 7 min) / 1 portion; where P is a man)) 
(SN- the need for tasty food). Ap concludes from this pattern, if man P is hungry {bef(P,b,ta) ~ -10 and des(P,b,ta) 
= 14) then Ap expects that the dish M(Lfg) will satisfy the hunger of P as follows: 
135 \ t = ta+7min ta+14min ta+21min 

bef(P,SN,t) -7 -4 -0.5 

des(P,SN,t) 11 8 4.5 

Ap sees that P would not have enough. If Ap knows that P is only little hungry (e.g. (bef(P,b,ta) = -1 and 
des(P,b,ta) - 5) then Ap expects that the dish M(Lfg) will satisfy the hunger of P as follows. 
140 \ / = ta+7mm ta+14min ta+21min 

bef(P,SN,t) -1 1 4.5 

des(P,SN,t) 5 4 0.5 

Example 2.2. Let vPm is a virtual skier in an entertainment software. vPm is a good skier and he is fond of skiing. 
He has the following properties in his behavior model, VS(ShJ), of skiing: 
145 E8 = ('ds\((85,100), epb(vPm,BW) - (4;(11,4.5),(12,3),(13,2),(14,1); 0.33 h) / h), 

(epb(vPm,AN) = (4;(7, 12),(8,1 1),(9,9),(I0,8); 0.33 h) / h), 
(epb(vPm,EN) = (4;(7.5,4),(8,3),(9,2),(9.5,1); 0.33 h) / h), 
(BW - the need for bodily activities, AN - for recognition, acknowledgment and self-esteem, EN - for relaxation). 
Let bef(vPm,BW,ta) = 0 and des(vPm,BWja) = 75. Before skiing, vPm expects, with probability 0.85, that his 



Schurmann, Description 

-6- 

1 50 BW - desire will be satisfied, during 3 h of skiing, as follows: 

\ / = ta+0.33h ta+0.66h ta+lh ta+1.33h ta+1.66h ta+2h ta+2.33h ta+2.66h la+3h 

bef(vPm,BW,t) 1 2 3 4 5 6 7 8 9 

des(vPm,BW,t) 13.5 12.5 11.5 10 9 8 6.5 5.5 4.5 
If vPm has values bef(vPm,AN,ta) = 0, des(vPm,AN,ta) = 18, bef(vPm,EN,ta) = 0, des(vPm,EN,ta) = 14 before the 
155 skiing, then he expects the following satisfactions (during 3 h of skiing): 





\ / = ta+0.33h ta+0.66h 


ta+lh 


ta+1.33h ta+1.66h 


ta+2h 


ta+2.33h 


ta+2.66h 


ta+3h 




bef(vPm,AN,t) 1 


2 


3 


4 


5 


6 


7 


8 


9 




des(vPm,AN,t) 17 


15 


14 


13 


11 


10 


10 


9 


8 




bef(vPm,EN,t) 0.5 


1.5 


2 


2.5 


3.5 


4.0 


4.5 


5.5 


6 


160 


des(vPm,EN,t) 13 


12 


11 


10 


9 


8 


7 


6 


5. 




fs = upb 


upb(Pd,b) = 


(p; n; 


(yl,zl),.. 


.,(yn,zn);qht)r\^\ 


z\eu\; OSALEj 





The meaning: OSA supports, in degree p(0<p< /), the increasing of bef(Pd,b,.) given by the pattern 



epb(Pd,b) = (n; (yl,zl),...,(yn,zn); q ht) [°| \°\ z]eu] 
which occurs in OSALEj (i.e. in the property Ej occurring in OSA1) 
165 Example 2.3. We use the example 2.2. The ski (model MfmSkJ) of vPm and good weather for skiing (model 
MfgSwJ) support the skiing of vPm. In the model M(mSk) are the properties 

(ds ,((85,100), upb(vPm,BW) = (0.25; 4;(1 l,4.5),(12,3),(13,2),(14,l); 0.33 h) / h; VS(Shf).E8), 
(upb(vPm,AN) = (0.15;4 ;(7,12),(8,1 1),(9,9),(10,8); 0.33 h) / h; VS(Shj).E8), 
(upb(vPm,EN) = (0.06;4 ;(7.5,4),(8,3),(9,2),(9.5J); 0.33 h) / h; VS(Shj).E8)). 
170 In the model M(gSw) occur the properties 

(ds ,((85,100), upb(vPm,BW) = (0.25;4 ;(l I,4.5),(12,3),(I3,2),(14,1); 0.33 h) / h; VS(Shj).E8), 
(upb(vPm,AN) = (0.2;4 ;(7,12),(8,1 1), (9, 9), (10, 8); 0.33 h) / h; VS(Shj).E8), 
(upb(vPm,EN) = (0.4;4 ;(7.5,4),(8,3),(9,2),(9.5J); 0.33 h) / h; VS(ShJ).E8)). 

fs = enb enb(Pd,b) = (n;(yl,zl) (yn,zn);q ht) [°|/[°| z]eu] 

175 where 1+yn <yl and zn > 1+zl. The meaning: Case: OSA is an object or a situation. According to Pd (at time td), 
there is an activity A V in the surrounding of OSA such that A V uses OSA and Pd expects that OSA (z eu of OSA, 
respectively) decreases bef(Pd,b,ta) and increases des(Pd,b,ta) (when A Fuses OSA) as given in (2). Case: OSA is an 
activity. Pd expects that when the activity OSA is applied to TV then bef(Pd,b,ta) will decrease and des(Pd,b,ta) 
increase as follows: 
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bef(Pd,bja+(i-l)*q ht) = v/ + dby, if v/ < bef(Pd,b,ta) 

=yi, if v/ < bef(Pd,b,ta) <yl 
(2) = bef(Pd, b, ta), \tyl > bef(Pd, b, ta) < yi 

des(Pd,b,ta+(i-l)*q ht) = zi + dbz, if des(Pd,b,ta) < zl 

-zi, ifzl<des(Pd,b,ta) <zi 

= des(Pd,b,ta), ifzl < des(Pd,b,ta) > zi, for / = /,...,«, 
where dby = bef(Pd,b,ta) ~yl (> 0), dbz - des(Pd,b,ta) - zl (< 0) and y2-yl +..+yn-yl < 0. These formulae are 
applied, by Pr21 and Pr22, similarly as those in (1): 
Pr21\ Case: neither Vz eu nor '/ eu ' occurs in enb. 

\ibef(b,ta) <yl then begin for / := 2 to n do bef(b,ta+(i-l)*q ht) :=» min(yi,bef(b,ta)); tl := /a end 
else begin r7 := to; 
while .y/ < bef(b,ta) do begin d&y := bef(b,tl) -yj; 

for » ~ 2 to « do bef(b,tl+(i-l)*q ht) :=yi + dby; tl := *7 + (n-l)*q ht end; 
*77 := tl; i :» 2; 

whiles > bef(b,tl) a / < n do begin / := i+7; r7/ := r7Y - i end; 
iff < n then for y := i to n do bef(b,tll+(j-l)*q ht) =yj; tl ~ til end. 
des(b,ta+(i-l)*q ht) is defined analogously as bef(b,ta+(i-l)*q ht) mPrll, 
Pr22: Case: 7z <?w or 7 eu occurs in enb. 

bef(b,la+(i-l)*q ht) is defined analogously as des(b,ta+(i-l)*q ht) in Prl2; 
des(b,ta+(i-l) *q ht) is defined analogously as bef(b,ta+(i-l) *q ht) in Prl2. 
Example 2.4. Let ES denotes an entertainment software in which a virtual person vP and a virtual physician vA are 
shown. vP has model M(Krk) of a cancer in which occur the following properties: 

E3 = ('ds\((80,100), enb(vP,GE) = (5; (~22,48),(-23,48),(-24,49),(-24,50),(-25,50); 5 days)), 
((70,100), enb(vP,LE) = (5; (-27,47),(-28,48),(-29,49),(-29,50),(-30,50); 5 days))), 
(LE - the need to be alive, GE - to be healthy). vP has (at time ta) the following values: 

bef(vP,GE,ta) = -i, des(vP,GE,ta) = 9, bef(vP,LE,ta) = S, des(vP,LE,ta) = 7. 
After the virtual physician v,4 told vP that he/she has cancer, v/* expects that the values of bef and des would alter, 
with probability 0.8 and 0. 7 (respectively), as given below, if vP does nothing against this disease: 
\ / = ta+5days ta+lOdqys ta+15days ta+20dqys ta+25days..... 
beJYvP.GEt) -2 -3 -3 -4 -5 
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210 des(vP,GE,t) 9 10 11 11 11 

bef(vP,LE,t) 7 6 6 5 4 

desfvP.LE.tJ 8 9 10 10 11 

bef(vP,GE,ia+155days) = -24, bef(vP,GE,ta+160daysJ = -25,...,bef(vP,GE,ta+275days) = -25, 
des(vP,GE,ta+265days) = 48, des(vP,GE,ta+270days) = 49, des(vP,GE,tcPc275days) = 50, 
215 bef(vP,LE,tch-245days) = -28. bef(vP,LE,ta+250days) = -29. bef(vP,LE,ta±255days) = -29. 
bef(vP,LE,(a+260days) = -30, bef(vP,LE,ta+290days) = -30, des(vP,LE,ta+280days) = 49, 
des(vP,LE,ta+285days) = 49, des(vP,LE,ta+290daysJ = 50. 

fs = unb unb(Pd.b) = (p; n; (yl,zl),...,(yn,zn);q ht) [°| /[°| 0&4 /.£/ 

The meaning: OSA supports, in degree p (0 < p < I), the decreasing of bef(Pd,b,.J by OSA1 according to the 
220 following pattern which occurs in OSAl.Ej, where 7z eu ' occurs in unb(Pd,bJ only if it occurs also in enb(Pd,b): 
Ej = .... enb(Pd,b) = (n; (yl,zlj,...,(yn,znj; q htj [°| /[°| z]eu] 
Example 2.5. Hg is a real dangerous dog. It belongs to a real person Pg. Real person P is a neighbor of Pg. Person 
P has a mobile agent system (a robot, an artificial servant), AD, which makes some domestic works. P and Pg 
quarrel with one another since 10 years. P was 3 times bitten by the dog Hg. Nevertheless, Pg often does not hold 
225 in leash his dog AD has in the model M(Hg) of the dog Hg (and in the model M(PgJ of Pg) the property 
E2 = ... ((60,100), enb(P.GE) = (5; (5, 8), (-8, 18), (-6, 16), (-3, 13), (0,9); 24 h)) 

( ((80,100), unb(P,GE) = (0.7; 5; (5,8),(-8,18),(-6,16),(-3.13),(0,9); 24 h), M(Hg).E2), respectively). 
AD concludes from these properties that, with probability 0.8, Pg supports in degree 0. 7 the aggressive behavior of 
the dog Hg against P. 

230 fs = vnb vnb(Pd,b) = (p ;n; (yl l.zl l),...,(yln,zln);q ht) [°[4°| z\eu\, OSAl.Ej 

The meaning. Instead of the expected decrease of bef(Pd,b,.) given by the pattern 
enb(Pd,b) = (n; (yl,zl),...,(yn,zn);q ht) z]eu] 

which occurs in OSAl.Ej, Pd expects that OSA will alter bef(Pd,b,.) and des(Pd,b,.), in degree p, (positive in 

comparison to enb(Pd,b) = (...) in OSAl.Ej) as follows: 
235 bef(Pd,b,tl+(i-l)*q ht) =yli, des(Pd,b,t2+(i-l)*q ht) = zlt, for / = / n 

where^/ > yi, zli <zi, 0<p<l, tl and t2 are determined in Pr21 or Pr22 for enb(Pd,b) = (...). 

Example 2.6. We use the situation described in Example 2 4 After diagnosis made by a virtual specialist in cancer 

(yAKs, in the Software ES ), the person vP built a model M(vAKs) of the doctor vAKs, which contains the following 

properties: 
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240 (vnb(vP,GE) = ffl.J; 5; (-12,33),(-ll,32),(-ll,32),(-10,32),(-9,32); 5 days); M(Krk).E3; where 

bef(vP,GE,ta) > -18 a / wr// perform the behaviors prescribed by the doctor vAKs ), 
(vnb(vP.LE) = (0.4; 5; (-1 1,35),(-1 1,35),(-10,35),(-10,34),(-10,33); 5 days); M(Krk).E3; where 
bef(vP,GE,ta) > -18 a I will perform the behaviors prescribed by the doctor vAKs ). 

fs = vpb vpb(Pa\b) = (p; n; (yll.zll) (yln,zln);q ht) [ 0 K°I z\eu]; OSAl.Ej 

245 The meaning: Instead of the expected increase of bef(Pd, b, .) given by the pattern 
epb(Pdb) = (n; (yl,zl),...,(yn,xn); q ht) [°|/[°| z]eu] 
which occurs in OSA1.EJ, Pd expects that OSA will prevent the increasing of bef(Pd,b„), in degree p, and determine 
bef(Pd,b,.) anddes(Pd,b, ) as follows: 

be/(Pd,b,tl+(i-l)*q hi) =yli, des(Pd,b,t2+(i-l)*q ht) =zli, for / = l,...,n 
250 whereby/ <yi, zli >zi, 0<p<l, tl and t2 are determined in Prll or Prl2 for epb(Pd,b) = (...). 

Example 2.7. Let ESI denotes an entertainment software in which a virtual 14 years old boy, vJl, and a virtual, 
violent boy vJg are shown. The boy vJI takes meal for lunch to the school. His model M(Frb) of this meal contains: 

El = Cds ,(epb(vJl,SN) * (5; (-I,7),(0,6),(l,5),(2,4),(3,3); 3 min); where bef(vJl,SN,ta) > -2),...). 
Unfortunately, probably vJl would not lunch because the violent boy vJg will take away his meal, with probability 
255 0.9. vJl has model M(vjg) of vJg, which include the properties: 

((45,50), vpb(vJI,SN)~(l; 5;(-l,7),(-l,7),(-l,7.5),(-L5,8),(-2,9);3min); M(Frb).El ;wheve 0.5>bef(vJl,SN,ta) >-2), 
(enb(vJ!MA) = (4; (-3,I0),(-5,I2),(-8,14),(-8,17); 0,5 h); where 3 > bef(vJ 1 MA,ta) > 
(enb(vJl,AN) = (¥; (-1,9),(-3,11),(-4,12),(-5,13); 20 min); where / > bef(vJl,AN,ta) > -3), 
(enb(vJl,KS) = (-1.6), (-3,8), (-5, 9), (-5, 12); 1 h); where bef(vJl,KS,ta) > -3). 
260 (where A£4 - to have power over people or animals, KS - to have no pain). 

/s = epbu epbu(Pd,b) = f»; (xl,dl),...,(xn,dn); q ht) 

where 25 > xi > 0 and ¥0 > dr > -¥0. The meaning: Case: OSA is an object or a situation. Pd can execute (at time 
to) an activity, AV, such that when Prf uses OSA in ,4 F then he/she expects that OSA will alter the function values 
bef(Pd,b,t) and des(Pd,b,t) as given in (3). Case: OSA is an activity. When Pd executes OSA correctly then Pd 
265 expects the following function values: 

(3) bef(Pd,b,ta+i*q ht) = bef(Pdb,ta) + xi, des(Pd,b,ta+i*q ht) = des(Pdb,ta) + di, for i = 7,...,w. 
Example 2.8. Let ESF denotes an entertainment software in which a virtual woman vFis showa Mrs. vF thinks, 
when she wears her golden brooch with rubies, vgBr, at a party (behavior VBtr) then she increases bef(vF,bat,.) 
according to the following pattern in the model M(vgBr) 
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270 Ell = (epbu(vF,bat) = (4; (1.5,-l),(2.5,-2),(2.5,-3),(2,~3); 1 h) 

where bat denotes the need for attractive appearance. 

fs = upbu upbu(Pdb) = (p; n; (xl,dl),...,(xn,dn);q ht); OSALEj 

where 25 >xi> 0 and 40 > di > -40. The meaning: OSA supports, in degree p(0<p< I), the increase of bef(Pd,b,.) 

by OSA 1 which contains the pattern: 
275 Ej = (ds\..epbu(Pd,b) = (n; (xl,dl),...,(xn,dn);q ht)...) 

Example 2.9. vPm denotes a virtual man in the software ESF (Example 2.8). vPm gave Mrs. vF a golden brooch 

with rubies vgBr. Mrs. vF has the model M(vgBr) of vgBr, with the property Ell given in Example 2.8. vF has also 

the model M(vPm) of vPm, which contains the property: 

(upbu(vF,bat) = (J; 4; (1.5-l),(2.5,-2),(2.5-3),(2,-3); I h); M(vgBr).El 1). 
280 fs = enbtt enbu(Pd,b) = f«; (xl,dl),...,(xn,dn); q hi) 

where 25>xi> 0 and 40 > > -40. The meaning: Case: 0X4 is an object or a situation. According to Pd (time to), 

there is an activity A V, in the surrounding of OSA, which uses OSA and Pd expects that OSA will decrease 

bef(Pd, b, (a) and increase des(Pd, b, la), as given in (4), when it is used by A V. Case : OSA is an activity. Pd expects 

that when activity OSA is applied to Pd then bef(Pd,b,ta) will decrease and des(Pd,b,ta) increase as follows: 
285 (4) bef(Pd,b,ta+i*q ht) = bef(Pd,b,ta) - xi, des(Pd,b,ta+i*q ht) = des(Pd,b,ta) + dr", for / = l,...,n. 

Example 2.10. The virtual person vP, in the software ES (Example 2.4), has model M(kGr) of the disease influenza, 

which contains the property 

E5 = ('ds';(enbu(vP,GE) = (4;(2,2),(3,4),(5,6),(6,7); 1 day)...), 
fs = unbu tmbu(Pd,b) = (p; n; (xl,dl),...,(xn,dn); q ht); OSALEj 

290 where 25 > xi >0 and 40 > di > -40. The meaning: OSA supports, in degree p (0 <p < 1), the decrease of 

bef(Pd,b,ta) by OSA1 which contains the pattern: 

Ej = (ds\..enbu(Pd,b) = (n; (xl,dl) (xn,dn); q ht)...). 

Example 2.11. The virtual person vP, in Example 2.10, has in the situation model, SMflcRn), of the situation 'to get 

wet in a cold rain' the property: 
295 unbu(vP,GE) = (0,6; 4; (2,2),(3,4),(5,6),(6, 7); 1 day); M(kGr).E5. 

2.3. Intensity of Stimuli 

Pd perceives OSA also as a stimulus when in OSA are ds - properties. Below, we define the intensity of 
stimulus of a ds -property and then of OSA, at time ta. We assume that in OSA occur not more than one properties 
of the form fs(Pd,b) = for a need b, where fs is defined above. 
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300 2.3.1. Positive Stimuli 

The patterns epb, upb, vnb, epbu, upbu in OSA represent positive stimuli. Let cd(q ht) = the time q ht given 
in hours, e g cd(2 days) = 48. 

a. [°| (Nba,Nb),] epb(Pd,b) = (n; (yl,zl),...,(yn,zn); q ht) 

Pi/ expects that the intensity of the positive stimulus of this property in OSA, at time ta, equals 
305 epr(Pd,OSA,epb,b,a,ta) = [°| (Nba/Nb)*] des(Pd,b,ta) * sqrt(cd(q ht) * ^ ((bef(Pd,b,tI+(i-l)*q ht) - 

bef(Pd,b,ta)) 2 + cr2* (des(Pd,b,ta) - des(Pd,b,t2+(i-J)*q ht)))) 
where a denotes ° ' (if '/[° | z] eu does not occur in epb) or k* zeu' (if 7[° | z] ei/" occurs in epb and Pc/ uses A:* z 
en of <9&4), '(Nba.Nb)*^ is applied only if (Nba.Nb) ' occurs before epA 1 , bef(Pd,b,tl+(i-l)*q ht), tl, t2 and 
des(Pd,b,l2+(i-I)*q ht) are determined in Pr/7 or Prl2 (Sect. 2.2), and (K cr2<I is a constant (suggest.: cr2=0.4). 

310 b. [°| (Nha,Nh), ] wpZ>(Prf, *; = fc; n; (yl,zl) (yn,zn); q ht) [°| /[°\ z] en]; OSAl.Ej 

where [°| (Nba.Nb),] epb(Pd,b) = (n;(yl,zl),...,(yn,zn),q ht) [°| /[°| z] eu] occurs in OX47 inTy. 

epr(Pd,OSA,upb,b,a,ta) = [°| (Nha/Nh)*] cbl* p *epr(Pd,OSAl,epb,b,a,ta) 
where 0.1 < cbl < I is a constant (sugg.: cbl = 0.6). 

c. [°| (Nha.Nh),] vnb(Pd,b) = (p,- »; (yl l,zl l),...,(yln,zln); q ht) [°| /t°| z] en]; OX4 /./y 
315 where [°i (Nba,Nb),] enb(Pd,b) = f«; (yl,zl),...,(yn,zn); q ht) [°| /[°| z] e«] occurs in 0&47 in 7y. 

epr(Pd,OSA,vnb,b,a,ta) = [°| (Nha/Nh)*]p* [°| (Nba/Nb)*] des(Pd,b,ta) * 
sqrt(cd(q ht) * Z =/ ^ (ft/7/ ->t) 2 + c/-2* fz/ - z7#jl). 

d. [°| (Nba.Nb),] epbu(Pd,b) = (n; (xl.dl),..., (xn.drt); q ht) 

epr(Pd,OSA,b,epbu,°,ta) = [°| (Nba/Nb)*] des(Pd,b,ta) * sqrt(cd(qht) * £ ; o ((xi) 2 + cr2* di)). 
320 e. [°| (Nha.Nh),] upbu(Pd,b) = (p; n; (xl,dl),...,(xn,dn); q ht); OSAl.Ej 
where OSAl.Ej contains the property epbu(Pd,b), given in (d). 

epr(Pd,OSA,upbu,b°,ta) = [°| (Nha/Nh)*] cbl * p* epr(Pd,OSAl,epbu,b,°,ta). 
For (...fs(Pd,b) = where C) holds. epr(Pd,OSA,bJs,a,ta) is defined if and only if C is true 
2.3.2. Negative Stimuli 
325 a. [°| (Nba,Nb),] enb(Pd,b) = (n; (yl,zl),...,(yn,zn); q ht) [°| /[°\ z] eu] 

Pd expects the following intensity of the negative stimulus of this property in OSA at time ta: 

enr(Pd,OSA,enb,b,a,ta) = [°| (Nba/Nb)*] max(des(Pd,b,t2+(i-l)*q ht) ,for Hl,...,n) * sqrt(cd(q ht) * 
S „ „ ((bef(Pd,b,tl+(i~l)*q ht) - bef(Pd,b,ta)) 2 + cr2* (des(Pd,b,t2+(i-l)*q ht) - des(Pd,b,ta)))) 
where (Nba.Nb)*' is applied only if '(Nba,Nb) ' occurs before 'enb \ bef(Pd,b,tl+(i-l)*q ht), tl, t2 and 
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330 des(Pd,b,t2+(i-I) *q ht) are determined in Pr21 or Pr22 (Sect. 2.2) and cr2 is the same constant as in Section 2.3 . 1 . 

b. [°| (Nha,Nh),] unb(Pd,b) = (p; n; (yl.zl),..., (yn,zn); q hi) [°| /[°| z]ew]; OSAI.Ej 
where [°| (Nba.Nb),} enb(Pd,b) = fn; (yl,zl),...,(yn,zn); q ht) [°| /[°| occurs in in £/. 

enr(Pd,OSA,unb,b,a,ta) = [°| (Nha/Nh)*} cbl*p* enr(Pd,OSAI,enb,b,a,1a). 

c. [°| (Nha,Nh),] vpb(Pd,b) = (p; n; (yl l,zl I),...,(yln,zln); q ht) [°| /[°| z]e«]; OSAI.Ej 
335 where [°| (Nba.Nb),} epb(Pd,b) = f»; (yl.zl) 6*»,z«;; <? A/; [°| /[°| z]eu] occurs in OSM/ in Ej. 

enr(Pd,OSA,vpb,b,a,ta) = [°| (Nha/Nh)*)p* [°| (Nba/Nb)*] des(Pd,b,ta) * 

sqrt(cd(q ht) * L =/ ^ ftyJi ->t> 2 + cr2* - zi^. 

d. [°| (Nha,Nh),\ vnb(Pd,b) = «; (yll.zll) (yln,zln); q ht) [°| /[°| r]0ir]; OSAI.Ej 

where in OSAI.Ej is the pattern enb(Pd,b) given in (a). 

340 enr(Pd,OSA,vnb,b,a,ta) = [°| (Nha/Nh) *] p* [°| (Nba/Nb) *] max(zli, for i=I,...,n) * 

sqrt(cd(q ht) *X _ ((dbyi) 2 + cr2* dzi)). 
where <%7 - bef(Pd,b,ta) -yli if bef(Pd,b,ta) >yli, dbyi = 0 otherwise, dzz = z// - des(Pd,b,ta) if zJi > 
des(Pd,b,ta), dzi = 0 otherwise. 

e. [°| (Nba,Nb),] enbu(Pd,b) = f»; (x/.rfyj fxw,^; ? *rj 

345 enr(Pd,OSA,b t enbu,°,ta) * [°| (Nba/Nb)*} (des(Pd,b,ta) + max(di,for i^l 

sqrt(cd(q ht) * £ =i b + cr2* <ft^> 
£ [°| (Nha,Nh),\ unbu(Pd,b) - <p; »; (xJ,dJ),...,(xn,dn); q ht); OSAI.Ej 
where OSAI.Ej contains the pattern enbu(Pd,b) given in (e). 

enr(Pd.OSA,unbu,b,°.ta) = [°| (Nha/Nh)*} cbl * p* enr(Pd,OSAI,enbu,b,°,ta). 
350 2.3.3. Intensity of Stimulus of an Object, a Situation or an Activity 

Every object, 0, is perceived as part of a situation, S. The stimulus of the object O is the stimulus of this 
object in the situation 51 Below, we define the intensity of stimulus of OSA when: 

- Pd perceives OSA at time ta, 

- if OSA is an object then OSA belongs to a situation S, 

355 - if OSA is an activity then Pd could execute this activity or the activity OSA could apply Pd. 

Let WB = {b e Bd(Pd) \ des(Pd,b,ta) > 0.33* mdes(Pd,ta) } and mdes(Pd,ta) - max(des(Pd,b,ta). for b e iBrf^ >• 
The intensity of positive stimulus of OSA 

pros(Pd,OSA,ta) = 2^ epr(PdOSAJsp,b,a,ia) 
where ./sp denotes epi, *(p6, epftw, wp*M or vn6, epr(Pd,OSAJsp,b,a,ta) is defined in Sect. 2.3.1 and 
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360 Bp={beWB\ (...fsp(Pd,b) = is in OSA } . 

The intensity of negative stimulus of OSA 

nros(Pd,OSA,ta) = enr(Pd,OSAjsn,b,a,ta) 

where fsn denotes enb, unb, enbu, unbu, vpb or vnb, enr(Pd,OSAfsn,b,a,ta) is defined in Sect. 2.3.2 and 
Bn = {b e WB \ (...fsn(Pd,b) = is in OSA }. 
365 The intensity of stimulus of OSA at time ta 

rosa(Pd,OSA,ta) = pros(Pd,OSA,ta) - crl * nros(Pd,OSA,ta) 

where 0.9 < crl < 1. 4 is a constant. If we assume that negative stimulus has a stronger effect than a positive one, 

then crl could be equal to 1.07. 

3. Representation of Joy and Dissatisfaction 
370 We define a function zful(Pd,b,ta) which values express contentment, pleasure, joy, great happiness, 

dissatisfaction, annoyance, anger, grief and suffering of Pd with respect to need In general the values of this 

functions are interpreted as follows: 

0 < zfiil(Pd,b,ta) <cfl - the intensity of contentment of Pd, with regard to need b, from the intensity 0 (no 
contentment) to cfl; 

375 cf < zful(Pd,b,ta) < cf2 - the intensity of joy - the greater this value the greater is the joy of Pd with regard to b, 
where cf<cfl< cf2; 

cf21 < zful(Pd,b,ta) - the intensity of happiness - the greater this value the greater is the happiness of Pd with regard 

to 6, where cfl < cf21 < cf2; 
0 > 7ful(Pd,b,ta) > cul - the intensity of dissatisfaction of Pd with regard to b - the smaller this value the greater is 
380 the dissatisfaction; 

cull > zftd(Pd,b,la) > cu2 - means annoyance, anger, grief or sadness of Pd with regard to b - the smaller this value 

the greater these feelings with regard to need b, where cull > cul; 
cu21 > zful(Pd,b,ta) > cu3 - means great physical or mental pain or deep sadness of Pd with regard to b - the 

smaller this value the greater these feelings, where cull > cu21 > cu2; 
385 cu3J > zful(Pd,b,ta) - means extreme suffering of Pd with regard to b, where cu21 > cu31 > cu3. 

Value zful(Pd,b,ta) alters in following cases: 
al . Pd perceives bef(Pd,b,ta) and des(Pd,b,ta) by its senses or sensors; 

a2. Pd perceives OSA, where Pd has a model of OSA (e.g. a situation model, a behavior scheme); 
a3. Pd perceives that he/she is achieving or he/she does not achieve his/her goal situation, Sz. 
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390 3.1. Alteration of tful(Pd,b,.) in Cases (al) and (a2) 

Case al : For need A, perceives bef(Pd,b,ta) and des(Pd,b,ta) by its senses or sensors, e.g. as a pain, hunger, 
sexual desire. Let dt(b) be the time interval after which Pd perceives these values. Examples: dt(KS) = 10 sec. if Pd 
has pain, dt(MA) — 1 mm (MA - to have power over people or animals). Let 

WB = {ie Bd(Pd) | des(Pd,b,ta) > 0.33* mdes(Pd,ta) } and mdes(Pdta) = max(des(Pd,b,ta), for ft e Bd(Pd)). 

395 The following operation is done if * e WB: 

(3.1) zful(Pa\b,ta) = zful(Pd,b,ta-dt(b)) + bef(Pd,b,ta) - bef(Pd,b,ta-dt(b)) + cr2*(des(Pdb,ta-dt(b)) - des(Pd,b,ta)) 
where cr2 is the same constant as in Sect. 2.3. The initial value of zful(Pd,b,.) can be (in normal cases) equal to the 
value bef(Pd,b,ts) > 0 such that des(Pdb,ts) < 0.5. 

Case a2 : Pd'is, with respect to OSA, in the situation described at the beginning of Sect. 2.3.3. Pdhas just identified 
400 (at time to) OSA and has observed that: 

- Pd is in the just perceived situation, S, and OSA belongs to S, if OSA is an object; 

- Pd is in the situation OSA, if 0&4 is a situation; 

- /W can execute the activity OSA or the activity can apply Pd, if OSA is an activity. 

For each ds - property 
405 (t°i (Na,N),\fs(Pd,b) « ... [°|; where C\) 

in OSA, such that if where C occurs then C holds, are executed the following operations: 

(3.2) zful(Pd,b,ta) .= zful(Pd,b,ta) + eel * ezfb(fs,b,ta) 

where ezfb(fs,b,ta) is defined below and 0.02 <cel< 1 is (for Prf) a constant, e.g. «r/ = 0.15 for ft/ who reacts not 
emotional and ce/ — 0.6 if /W reacts emotional. 
410 If/s denotes epA, w/>6, epbu, upbu, vnb, vpb and des(Pdb,ta) < 0.33* mdes(Pd,ta) or fs denotes enb, unb 

and max(des(Pd,b,t2+(i-l)*q ht), for i=l,...,n) < 0.33*mdes(Pd,ta) (where des(Pd,b,t2+(i-l)*q ht) is determined in 

iV2/ or Pr22, Sect 2.2) or> denotes e»6tt, w«6w and des(Pdb,ta)+max(di, for «) < 0.33 * mdes(Pd,ta), 

then ezfb(fs,b,ta) = 0. 

Let des(Pdb,ta) > 0.33* mdes(Pd,ta). We define <?s/& for epb, upb, vnb, epbu, upbu, vpb: 
415 ezfb(epb,b,ta) = [°| (Na/N)*] (duy(epb,b) + cr2 * (des(Pd,b,ta) - des(Pdb,t2+(n~l) *q ht))) 

where duyfepb.b) - max(bef(Pdb,tl+(i-l)*q ht), for i=l,...,n) - bef(Pd,b,ta), and bef(Pd,b,tl+(i-I)*q ht), 
des(Pdb,t2+(n-l)*q ht))) are determined in PriV or Prl2 (Sect. 2.2). 

ezfb(upb,b,ta) = [°| (Na/N)*} cbl * p* ezfb(epb,b,1a) 
where ([°\ (Nba,Nb),] epb(Pd,b) = ...) occurs in OS/1 /.£/. 
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420 ezfb(vnb, b, ta) = [°| (Na/N)*]p *[°| (A7>a / M>> *] (duyl(vnb, b) + cr2 * (z« - z /« - <&«) 

where ([°| (Na,N),] vnb(Pd,b) = «; (yl l,zl l)....,(yln,zln); q ht); OSAl.Ej) occurs in OSL4, duyl(vnb,b) =yln - 
yn - dbyn, ([°\ (Nba,Nb),] enb(Pd,b) = f»; (yl,zl),...,(yn,zn); q ht)) is in OX4 /./^, <%n = bef(Pd,b,ta) -yln if 
bef(Pd,b,ta) >yln, dbyn = 0 otherwise, dfew = z//i - des(Pd,b,ta) if r/« > des(Pd,b,ta), dzn ~ 0 otherwise. 
ezfb(epbu,b,ta) = [°| (Na/N)*] (duy(epbu,b) - cr2 * 
425 where duy(epbu,b) = max(xi, for r=^l,...,n). 

ezfb(upbu,b,ta) = [°| (Na/N)*] cbl * p* ezfb(epbu,b,ta) 
where (...epbu(Pd,b) = is in OSAl.Ej. 

Let fH #for,A0,] vpb(Pd,b) = fc; (yl I,zl l),...,(yln,zln); q ht); OSAl.Ej) occurs in OS^. 

(Nba.Nb),] epb(Pd,b) = f«; (yl,zl),...,(yn,zn); q hi)) is in OSAl.Ej and duyl(vpb,b) = v7/i - jot. 
430 ezfb(vpb,b,ta) = [°j (Na/N)*]p* [°| (Nba/Nb)*] (duyl(vpb,b)+ cr2* (zn-zln)). 

Now we define t?z/& for and wwA. We assume, max(des(Pd,b,t2+(i-l)*q ht), for i=l,...,n) >0.33*mdes(Pd,ta). 
ezfb(enb,b,ta) = [°| (Na/N)*] (duy(enb,b) + cr2* (des(Pd,b,ta) - des(Pd,b,t2+(n-l)*q ht))), 
where duy(enb,b) = min(bef(Pd,b,tl+(i-l)*q ht), for i=l,...,n) - bef(Pd,b,ta), and bef(Pd,b,tl+(i-l)*q ht), 
des(Pd,b,t2+(n-l) *q ht))) are determined in Pr27 or 7V22 (Sect. 2.2). 
435 ezfb(unb,b,ta) = [°| (Na/N)*] cbl * p* ezfb(enb,b,ta) 

where (Nba,Nb),] enb(Pd,b) = ...) is in OSAl.Ej. 

Let des(Pd,b,ta) + max(di, for i=l,...,n) > 0.33* mdes(Pd,ta) and duy(enbu,b) = - /naxrfx/, for i=l,...,n). We 
define ez/Z> for e«£w and w«2>m. 

ezfb(enbn,b,ta) = [°| (Na/N)*] (duy(enbu.h) - cr2 * </«) 
440 ezfbfunbu, b, ta) = [°| (Na/N)*] cbl *p* ezfb(enbu, b, ta) 

where (...enbu(Pd,b) = ...> is in OSAl.Ej. 

After operations (3 .2) are executed, for cfc properties in 0&4, /></ can perceive the alterations of bef(Pd, b, t) 
and des(Pd,b,t) by senses or sensors (or simulate them). In this case, the operations (3.1) are executed. 
3.2. Satisfaction and Dissatisfaction when fW is Achieving a Goal 
445 A goal is a situation, &, having relative great value rosa(Pd,Sz,ta), at time ta, and which can be achieved, accor- 

ding to Pd. First we consider the case (a3), where Pd realizes achieving of a goal situation Sr. Pd decided (at time 
//), on the basis of his/her motivation function and his/her activity descriptions, that Sz is the situation which Pd will 
achieve till time t2. Let pz(t) be the probability of achieving the goal Sz (as Pd estimates at time r). pz(t) can be 
interpreted as the hope of Pd (at time i) of achieving the goal Sz. Situation Sz is added to list LZS as follows: 
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450 (3.3) (Sz,pz(t),tl,t2; dsEl,...,dsEu; AVl,...,AVw;...) 

where dsEi denotes a new ds - property of the goal Sz (added to the list in the time (tl,ta)\ and A Ve (e < w) are the 
activities by which Pd plans to achieve the situation Sz. dsEi has one of the following two forms- 
(dser; ([°\ (Na,N),]fs(Pd,b) = ...) - Pd expects (with probability Net / N) that, (immediately) after he/she achieves 
the situation Sz, bef(Pd,b,.) and des(Pd,b,.J will change according to the pattern fs(Pd,b) = where fs 
455 denotes the same symbols as in Sect. 3.1 (in most cases,> is here a pattern that increases bef(Pd,b,.)), 

('dsne V ([°\ (Na,N),]fs(Pd,b) = ...) - Pd expects (with probability Na / N) that, when he/she does not achieve the 
goal situation Sz, bef(Pd,b r .) and des(Pd,b,.) will change according to the pattern fs(Pd,b) = ... (in most 
cases, fs is here a pattern that decreases bef(Pd,b,.)) 
Example 3.1. v/7is a virtual man in an entertainment software. He has a small business. His goal situation, Sei, is to 
460 increase the income of his business at least by 2.5 % in one year. He hopes to achieve this goal with probability 

pz(tl)= 0.85. After 2 month he concludes that, if he does not achieve this goal and the income increases only by x % 
(or decreases if x < 0) then his reputation as a manager would decrease as given by the pattern: 

(dsne -, (91,100), enb(vH,AN) = (5; (2.2*(2-x),2.5*(2-x)), (2.1*(2-x),2.4*(2-x)), (2*(2-x),2.4*(2-x)), 
(1.9*(2-x),2.3*(2-x)), (1.9*(2-x),2.3*(2-x)); 3 days), where -6 <x<2)) 
465 (AN - the need for recognition, acknowledgment and self-esteem). However, if vH achieves the goal - the income of 
his business would increases by (2. 5+z)% (z>0) - then his manager reputation would increase as given by the pattern 
fdsre\- (98,100), epb(vH,AN) = (5;(2.8*(l+z),-1.8*(l+z)), (2.6*(I+z),-1.6*(l+z)), (2.6*(l+z),-J.6*(I+z)), 
(2.5*(I+z),-1.5*(l+z)), (2.4*(I+z),-1.4*(l+z)); 3 days), where 0 <z < 5)). 
These two properties are attached to the goal situation Sei (in LZS) at time tI+2 month. 
470 Goal situation Sz in LZS determines the need, bsz, of Pd to achieve the situation Sz.. The reason for the need 

bsz (a motivation) is the expected increase of satisfaction, efrz(Pd,Sz,ta), when the goal Sz would be achieved. This 
expected (at time td) increase of satisfaction can be expressed as follows 

efrz(Pd,Sz,ia) = ezfb(sf,b,ta) * pz(ta) 
where Bz = {b | (...fs(Pd,b) = ...) occurs in Sz or ('dser; (...fs(Pd,b) = is attached to Sz in the list LZS } and 
475 ezfb(sfb,.) is defined in Sect. 3 1. When Pd is achieving the goal Sz, zfu/(Pd,b,.) alters as given in (3.2), where OSA 
denotes the situation Sz with the dser ' - properties given in (3.3). Thus, when Pd perceives (at time t2d) that he/she 
will achieve the goal Sz, the satisfaction and joy increases by 

frez(Pd,Sz,t2a) = eel * efrz(Pd,Sz,t2a) where 0.9 < pz(t2a) < 1. 
When Pd has achieved the situation Sz, Pd perceives bef(Pd,b,.) and des(Pd,b,.) by senses or sensors, for * e Bz. 
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These changes of bef(Pd,b,.) and des(Pd,b,.J increase zful(Pd,b,.) as given in (3.1), for b e Bz, and they must not 
agree with the patterns (...fs(Pd,b) -..) in Sz and (dser '; (...fs(Pd,b) = ...)) attached to & in LIS. The satisfaction 
and joy resulting from achieving the goal Sz, at time t > t2a, equals 

frz(Pd,Sz,t2a,t) = zful(Pd,b,t) - zful(Pd,b.t2a-dtl) 
when Pd perceives the said changes of bef(Pd,b,.) and des(Pd,b,.) (in time (t2a-dtl,t)) as the result of achieving the 
goal Sz, where 0<dtJ < 15 min. 

Satisfaction and dissatisfaction when achieving of goal situation is realized . In order to achieve goal Sz, Pd performs 
some activities AVl,...,AVw (s. (3.3)). To each activity AVe, we attach (in (3.3)) the following property: 

(dsz -, ([°\ (Nea.Ne),] re(bsz) = he)), where 0<he<L 
The meaning: Pd thinks, that A Ve realizes the achieving of the situation Sz in degree he, i.e. if Pd performs A Ve 
correct and achieves the expected intermediate goal situation (intermediate goal), zSze, then Pd thinks he/she 
approached the goal Sz in degree he. Before Pd performs the activity A Ve, Pd expects that he/she achieves the 
intermediate goal zSze, with probability Nea / Ne, and then (after zSze has been achieved, at time ta+xf) will increase 
his/her satisfaction and joy, i.e. the value zful(Pdb,ta+xt), by he*cel *efrz(Pd,Sz,ta). 

If an obstacle appears which prevents (or makes difficult) either the continuation of the activity AVe or the 
achieving of the intermediate goal zSze, in degree 0<ge<J, then the dissatisfaction of Pd increases by the value 
ge*he*cel*efrz(Pd,Sz,ta), i.e. by this value decreases £ t-iU(p4) zfiil(Pd,b,ta+xt). lfge =i then (according to Pd) Pd 
cannot achieve the intermediate goal zSze by the activity A Ve. 

Dissatisfaction and disappointment when Pd does not achieve a goal . At time ta-xt, Pd believed that he/she would 
achieve the goal situation Sz with probability pz(ta-xt), where xt is a small interval of time. In the time (ta-xt, ta), Pd 
becomes aware that he/she did not or cannot achieve Sz. The intensity of the dissatisfaction and disappointment, at 
time ta, equals 

unen(Pd,Sz,ta) = eel *(efrz(Pd,Sz,ta-xt) - ezfb(sf,b,ta) ) 
where Bnz = {b \ (dsne ;(...fs(Pd,b) = ...)) is attached to Sz in the list LZS} and ezfb(sf,b,.) is defined in Sect. 3.1. 
Also the following operations are executed: 

zful(Pd,b,ta) := zful(Pd,b,ta) - ceJ*pz(ta-xt)* ezfb(fs,b,ta), for b e Bz, 

zful(Pd, b, ta) ~ zJul(Pd b, ta) +cel* ezfbtfs, b, ta), for b <e Bnz. 
Afterwards (time t > ta) Pd perceives bef(Pd,b,t) and des(Pa\b,t) by senses or sensors for b e Bnz. These changes of 
bef(Pd,b,.) and des(Pd,b,.) cause the decrease of values zful(Pdb,t) as given in (3.1) for b <= Bnz. 
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4. Feelings: Affection, Love, Aversion, Anger 

5io In this section, we describe formally the feelings to/for an object, a situation or an activity (OSA). liking, sympathy, 
affection, love, dislike, aversion, anger, hate. Dislike, anger and hate are considered more exactly in Sect. 6. Human 
has needs which are associated with affection and love towards objects. Examples: ELM -the love of mother to her 
child, MU - the need for music, NaW - the need to have knowledge in the area of natural science. The mentioned 
emotions originate not only from such needs. When a human or a mammal, Pa, perceives that an another human 

515 or mammal. Pan, caused an increase (or a decrease) of bef(Pa,b,.), then Pan arises sympathy, affection or love of Pa 
towards Pan (dislike, aversion, anger or hate of Pa towards Pan, respectively). These feelings Pan arises also if Pan 
is not a living object, e.g. Pa likes his car, affection to Alps, affection for alcohol, aversion to dung. Also an activity, 
A V, causes such feelings when A V changes bef(Pa,b,.), e.g. person P is fond of skiing. We describe the mentioned 
states of feelings of Pd to/for OSA by functions: 

520 zulieb(Pd,OSA,ta) - the intensity of liking and affection of Pd to/for OSA (at time id) - the greater this value the 
stronger is the positive feeling of Pd Tor OSA; 
abhas(Pd,OSA,ta) - the intensity of dislike, annoyance and anger of Pd to/for OSA - the greater this value the 
stronger is the negative feeling of Pd for OSA. 

The values of these functions are determined when Pd perceives that: 
525 i. OSA caused, supported or prevented an increase or decrease of bef(Pd,b,ta-xtb) or des(Pd,b,ta-xtb) in time 
(ta-xtb, ta); 

ii. OSA carried out, supported or prevented achieving of a goal situation listed in LZS'm time (ta-xtb, ta). 
4.1 OSA Effected Alteration of Values bef(Pd,b,.), des(Pd,b, ) 

First, we consider the case (i). abhas(Pd,OSA,ta) increases when Pd perceives that: 
530 al . OSA caused or supported, in degree g(b) (0< g(b)< 1), the decrease of bef(Pd,b, ta-xtb) by dy(b), or OSA 
prevented, in degree g(b), the increase of bef(Pd,b,ta-xtb) by dy(b), in the time (ta-xtb,ta); i.e. dy(b) = 
beffPd.b, ta-xtb) - bef(Pdb,ta) or if no OSA J (eg OSA ) had prevented the increase of bef(Pd,b,ta-xtb) then 
bef(Pd,b,ta) would have been (according to Pd) greater by dy(b) (dy(b) > O.J); 
a2. if OSA is an object, Ob, then Pd thinks that Ob had no right to perform or to support the decrease of 
535 bef(Pd, b, ta-xtb) by dy(b) or to prevent the increase of beffPd, b, ta-xtb) ; 

a3. Pd believes (perceives) that OSA caused or supported consciously, in degree 0 < nr(OSA,b) < 7, the decrease of 
bef(Pd,b, ta-xtb) by dy(b) or prevented consciously, in degree nr(OSA,b), the increase of bef(Pd,b, ta-xtb) by dy(b). 
Most of educated people have 0 < nr(nOPT,b) <0.2 where nOPT denotes a not living object, a plant or a 
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primitive animal. An inhabitant of a primeval forest, 2000 years ago, had 0. 7< nrfthunder and lightning, bs) < 1 for 
540 a safety need bs. Soldiers of an army, Al, who fight against soldiers, SA2, of an army A2, have 0.8 < nr(SA2,bs) < I. 
When (al), (a2) and (a3) take place then abhas and zulieb change as follows: 

(4. 1) abhas(Pd,OSA,ta) ~ abhas(Pa\OSA,ta) + nr(OSA,b) * g(b)* cfy(b) * des(Pd,b,ta) 

(4.2) zulieb(Pd,OSA,ta) := zulieb(Pd,OSA,ta) - ca* nr(OSA,b)* g(b) * dy(b) * des(Pd,b,ta) 
where ca is a constant for Pd, 0<ca<0.6 (sugg.: ca — 0.2). 

545 Case: (a2) does not hold, i.e. (al) and (a2) holds, OSA is an object, Ob, and Pd thinks that Ob has the right to 

perform and to support the decrease of bef(Pd,b,ta-xtb) by dy(b) or to prevent the increase oXbef(Pd,b,ta~xtb). In 

this case, only operation (4.2) is executed. 

zulieb(Pd,OSA,ta) increases when Pd perceives that: 

bl. OSA caused or supported, in degree p(b) (JX p(b)< J), the increase of bef(Pd,b,ta-xtb) by dz(b) or prevented, in 
550 degree p(b), the decrease of bef(Pd,b,ta~xtb) by dz(b), in the time (ta-xtb,ta). i.e. dz(b) = bef(Pd,b,ta) - bef(Pd,b,ta- 

xtb) or if no OSA I (e.g. OSA ) had prevented the decrease of bef(Pd,b,ta-xtb) then bef(Pd,b,ta) would have been 

(according to Pd) smaller by dz(b) (dz(b) > 0. 1); 

bl. if OSA is an object, Ob, then Pd thinks that Ob was not obliged to perform or to support the increase of 

bef(Pd,b,ta-xib) by dz(b) or to prevent the decrease ofbef(Pd,b,ta-xtb); 
555 b3. Pd* believes (perceives) that OSA consciously caused or supported, in degree 0 <pr(OSA,b) < 1, the increase of 

bef(Pd,b,ta-xtb) by dz(b) or OSA prevented, in degree pr(OSA,b), the decrease of bef(Pd,b,ta-xtb) by dy(b). 

Most of educated people have 0<pr(nOPT,b) <0.2, where nOTP denotes the same objects as above. However, 

a successful soccer-player can have values 0.5<pr(FB,AN)< 0.8, 0.5<pr(FB,Rei)< 0.8, where FB - ball for playing 

soccer, AN- the need for recognition, acknowledgment and self-esteem, Rei - to be rich. Inhabitant of a primeval 
560 forest, 2000 years ago, who looked upon a big oak tree as a deity, had 0. 7 <pr(oak,be) < 1 for some needs be. A 

not educated farmer can have pr(good field,gE) - 0.5, pr(bad fieldgE) = 0, where gE denotes to have good crop' . 

An agrarian engineer has: pr(good fieldgE) = pr(bad fieldgE) = 0. An enthusiastic musician can have 0.5 < 

pr(music,MU)< 1 

When (bl), (b2) and (b3) take place then zulieb and abhas change as follows: 
565 (4.3) zulieb(Pd,OSA,ta) := zulieb(Pd,OSA,ta) + pr(OSA,b)* p(b)* dz(b)* des(Pd,b,ta-xtb) 

(4.4) abhas(Pd,OSA.ta) .= abhas(Pd,OSA,ta) - ca * pr(OSA,b)* p(b)* dz(b)* des(Pd,b,ta-xib). 
4.2. Involvement of OSA when Pd Realizes Achieving a Goal Situation. 

We consider the case (ii) (s. Sect. 4, the beginning). First, we assume that OSA realizes or supports achieving 
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of a goal situation Sz of Pd. zulieb(Pd,OSA,.) increases when Pd realizes achieving of an intermediate goal 
570 situation, zSze, by an activity AVe, in time (ta-zt,ta), and perceives that: 

- OSA performed or supported, in degree 0< zpe< 1, achieving of the intermediate goal zSze in time (ta-zt,ta); 

- if OSA is an object (Ob) then Pd thinks that Ob was not obliged to perform or to support the achieving of the 
intermediate goal zSze; 

- Pd believes (perceives) that OSA consciously, in degree pr(OSA,bsz), performed or supported, in degree zpe, the 
575 achieving of the intermediate goal zSze, where bsz denotes the need to achieve the goal Sz; 

The symbols A Ve, zSze have the same meaning as in Sect. 3 .2. pr(OSA,b) has the same meaning as in Sect. 4. 1 . Let 
Bzz = {(fs.b) | \des(Pd,b,ta-zt) > 0.33* mdes(Pd,ta-zt) a fs denotes epb, upb, epbu, upbu, vnb, vpb v 

des(Pd,b,ta) > 0.33* mdes(Pd,ta) a fs denotes enb, unb, enbu, unbu] a [(...fs(Pd,b) = ...) occurs in Sz v 

(dser -, (...fs(Pd,b) = ... .)) is attached to Sz in the list LZS]}. 
580 For (fs,b)^ Bzz, zulieb and abhas are changed as follows: 

(4.5) zu/ieb(Pd,OSA,ta) := zulieb(Pd,OSA,ta) + zul(OSA,b,ta) 

(4.6) abhas(Pd,OSA,ta) := abhas(Pd,OSA,ta) - ca * zul(OSA,b,ta) 

where. zul(OSA,b,ta) = ce2* [°\(Nba / Nb)*] pr(OSA.bsz)* zpe* he* pz(ta-zt)* duy(fs,b)* desz(b,ta), 
zpe, he, pz(t) have the same meaning as in Sect. 3.2, 0 < ce2 < J (sugg. ce2 = ceJ+0.2), 

585 desz(b,ta) = des(Pd,b,ta-zt) , if fs denotes epb, upb, epbu, upbu, vnb, vpb 
= des(Pd,b,ta), if fs denotes enb, unb, enbu, unbu, 
duy(epb,b), duy(epbu,b), duy(enb,b), duy(enbu,b), duyl(vnb,b), duyl(vpb,b) are denned in Sect. 3.1, 
duy(upb,b) = cbl* p* duy(epb,b), duy(upbu,b) = cbl* p* duy(epbu,b), duy(vnb,b) = p* duyl(vnb,b), 
duy(vpb,b) - p* duyl(vpb,b), duy(unb,b) = cbl* p* duy(enb,b), duy(unbu,b) = cbl* p* duy (enbu, b). 

590 QSA prevents achieving a goal situation Sz. abhas(Pd,OSA,ta) increases when Pd realizes achieving of intermediate 
goal situation zSze of the goal Sz by an activity A Ve, in time (ta-zt, ta), and perceives that 

- OSA prevented, in degree 0 < zge < 1, the achieving of the intermediate goal zSze in time (ta-zt,ta); 

- it OSA is an object (Ob) then Pd thinks that Ob had no right to prevent the achieving of the intermediate goal zSze; 

- Pd believes (perceives) that OSA consciously, in degree nr(OSA,bsz), prevented, in degree zge, the achieving of 
595 the intermediate goal zSze. 

For (fs,b) in Bzz, zulieb and abhas are changed as follows: 

(4.7) abhas(Pd, OSA,ta) := abhasfPd, OSA, ta) + abh(b, ta) 

(4.8) zu!ieb(Pd,OSA,ta) := zulieb(Pd,OSA,ta) -ca* abh(b,ta) 
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where: abh(b,ta) = [°| (Nba / Nb)*\ nr(OSA,bsz)* zge* he* pz(ta-zt)* duy(fs,b)* desz(b,ta), zge, he,pz(l), desz(b,ta) 
600 and duy(fs,b) have the same meaning as above. Additionally, for Bnz (Bnz is defined in Sect. 3.2), are executed 
the operations 

(4.9) abhas(Pd,OSA,ta) := abhas(Pd,OSA,ta) - nr(OSA,bsz) *zge* he* pz(ta-zt)* duy(fs,b)* des(Pd,b,ta) 

(4. 10) zulieb(Pd,OSA,ta) := zuheb(Pd,OSA,ta) + ca* nr(OSA,bsz)* zge* he* pz(ta-zt) * duy(fs,b)* des(Pd,b,ta). 
Remark: duy(fs,b) < 0 for almost all b in Bnz. 

605 If OSA is an object, Ob, and Pd thinks Ob had the right to prevent the achieving of the intermediate goal zSze then 
only zulieb changes as given in (4.8) und (4. 10). 
5. Retaliation and Revenge 

When abhas(Pd,Ob,ta) increases and Ob is a living object then it can arise the need, bvr(Ob), of Pdibr retalia- 
tion and revenge on Ob, if nr(Ob,b)>cr for some needs b <= Bd(Pd) (sugg- cr=0.J). Usual in this case, Ob denotes a 
6io human, people, an organization (if Pd is a human) or a number of animals. If Pd is a mammal (e.g. a bulldog) then 
Ob may be also a non living object. bef(Pd,bvr(Ob),.) and des(Pd,bvr(Ob),.) depend on the degree of inclinatioa 
0< gr(Pd) < 1, of Pd for revenge. If OSA is an object Ob such that nr(Ob,b) >cr, for some b in Bd(Pd), and 
abhas(Pd,Ob,ta) increases as given in (4 1), (4.7) or (4.9), then also the following operations are executed (changes 
ofbef(Pd,bvr(Ob),.) and des(Pd,bvr(Ob),.)): 
615 if bvr(Ob) e Bd(Pd) then begin bef(Pd, bvr(Ob), to) = max(bef(Pd, bvr(Ob), (a) - dbh(b), -20); 

des(Pd,bvr(Ob),ta) := min(des(Pd,bvr(Ob),ta) + chl* dbhfb), 50) end 
else begin Bd(Pd) := Bd(Pd) o bvr(Ob); 

bef(Pd,bvr(Ob),ta) := max(18 - dbh(b), -20); des(Pd,bvr(Ob),ta) := min(chl* dbh(b), 50) end 
where 0.8 < chl < 2 is a constant (sugg. chl = 1.3), 
620 dbh(b) = gr(Pd) * nr(Ob, b) * g(b) * sqrt(dy(b) * 0.5* des(Pd, b, ta)), if (4. 1 ) was executed 
= [°| (Nba /Nb)*] gr(Pd) * nr(Oh,bsz) * zge* he* pz(ta-zt) * sign(duy(fs,b))* 

sqrt(\ duy(fs,b) \* 0.5* desz(b,ta)), if (4.7) was executed 
= [°| (Nba / Nb) *] gr(Pd) * nr(Ob,bsz) * zge * he * pz(ia-zt) * sign(duy(fs,b)) * 

sqrt(\ duy(fs,b) |* 0.5* des(Pd,b,1a)), if (4.9) was executed, 
625 and the other used symbols have the same meaning as in (4. 1), (4.7) und (4 9). 

bef(Pd,bvr(Ob),.) increases when zulieb(Pd,Ob,.) increases and abhasfPd.Ob,.) decreases. If OSA is an 
object (Ob), bvr(Ob)& Bd(Pd) and pr(Ob,b) > cr and operations (4.3) or (4.5) were executed, then bef(Pd,bvrOb) ,.) 
and des(Pd,bvr(Ob),.) change as follows: 
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bef(Pd,bvr(Ob),ta) min(bef(Pd,bvr(Ob),ta) + ca2* bsh(b), 12) 

des(Pd,bvr(Ob),ta) = max(des(Pdbvr(Ob),ta) -chl*ca2* bshfb), 2) 
where (X ca2 <4, the used symbols have the same meaning as in (4.3) and (4.5), 
bsh(b) = pr(Ob.b) * p(b)* sqrt(dz(b)* 0.5* des(Pd,b,ta-xt)), if (4.3) was executed 

= [°| (Nba / m)*]pr(Ob,bsz)* zpe* he* pz(ta-zt)* sign(duy(fs,b))* sqrt(\duy(fs,b) |* 0.5* desz(b,ta)), 

if (4.5) was executed. 

ca2 is a constant which must be determined for each Pd For people who are inclined to forgive holds 1.5 < ca2 < 4. 

For vindictive people holds 0< ca2< 0.8. 

6. Frustration, Anger, Fear 

6.1. Frustration, Depression, Sadness, Anger 

First, we define apathy. Pd is apathetic in time (ta-cta,ta) if -0.2* cf <zfuI(Pd,b,t) <0.2*cf, for Bd(Pd), 
and mdes(Pdt) < 2, for ta-cta <t<ta, where eta > 2 weeks and cf is the constant introduced at the beginning of 
Sect. 3. To Bd(Pd) can belong also needs, bsz, 'to achieve situation Sz\ Let 

Bd(Pd) | des(Pd,b,ta) > 0.33* mdes(Pdta) }. 
Frustration. Pd may be frustrated with respect to need b, at time to, when: 

i. Pd is not joyful at time ta, i.e. zful(Pd,bl,ta) < c/for bl e WB; 

ii. zful(Pd, b.ta) < 0 and Pd thinks that he/she can perform only activities A Vbl,... ,A Vbr which either decrease 
zful(Pdb,ta) by dzf(b) >0, with probability pf(b, ta), or increase zful(Pd,b,ta) by dzh(b) >0 with probability ph(b,ta). 
Pd is frustrated with respect to b e ffB, at time ta, with intensity 

frusb(Pdb,ta) = - zful(Pd,b,ta) + pffb.ta)* dzf(b) - ph(b,ta)* dzh(b) 
if (i) and (ii) hold and frusb(Pd,b,ta) > 0. Let 

fi/= {6e J^BI/Wis frustrated with respect to b at time ta }. 
The intensity of frustration of Pd at time to: 

frust(Pdta) = frusb(Pd,b,ta) ). 

D ep r ession. . We use the above introduced symbols. Pd is depressed with respect to need b, at time to, when: 

- Pd is frustrated with respect to need b, frusb(Pdb,ta) >cfl and, according to Pd, frusb(Pd,b,t) >cfl for ta< t< ctd; 

- according to Pd ph(b,t) = 0, for ta< t < ctd, i.e. Pd thinks he/she cannot perform an activity which would increase 
zfiil(Pdb,ta) (or bef(Pd,b,ta)) in the time (ta,ctd); 

- according to Pd zful(Pd,bl,t) < 0.5 * cf for bU Bd(Pd) and to < / < ctd, 

where ctd - ta >1 year (sugg. : ctd - ta -3 years) and cf, cfl are the constants introduced at the beginning of Sect. 3 . 
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The intensity of depression of Pd with respect to b at time ta. 
660 depb(Pd, b, ta) =frusb(Pd, b, ta) -cfl. 

Let Bs = {fte WB \ Pd is depressed with respect to b at time ta) 

The intensity of depression of Pd at time ta 

depr(Pd,ta) = depb(Pd,b,ta). 

Sadness Pd can be sad in the following cases: 
665 i. Pd has lost person (or animal), whom he/she loved, for a long time, 

ii. Pd or person whom Pd loves is very sick and will be sick for a long time, 

iii. Pd has been sent to prison or A/ has lost his/her whole property; 

iv. Pd has concluded that he/she will not be able to perform his/her favourite activity; 

v. Pd has concluded that he/she cannot achieve his/her important goal. 

670 In order to define sadness, we describe the above formulations more precisely. Pd loves an object, Ol, if 

zulieb(Pd,Ol,ta) > ell >4 and abhas(Pd,OJ,ta)< 1, where ell is a constant. In this case holds rosa(Pd,Ol,ta) > cwl 
for a constant cwl (sugg.: cwl — 50). Time interval, tr, is a long time if tr > ctl, where ctl is a constant depending on 
Pd. Examples: ctl = / week for an 8 years old child, ctl = I month for an 12 years old child: ctl = 0.5 year for a 20 
years old man. Pd has lost an object (Ol) or had to separate from this object" means Pd has not the satisfactions of 

675 the intensity rosa(Pd,01,ta) > cwl associated with Ol. Be very sick or a loved person is very sick" means: Pd is in a 
grave situation Sw, i.e. Pd perceives negative stimulus of the intensity rosa(Pd,Sw,ta) < - cwl. Be in prison or lose 
his/her whole property' means, as above, that Pd is in a grave situation Sw. (iv) is a case of Pd had to give up 
activity, A VI, such that rosa(Pd,A Vl,ta) > cwl, i e. Pd has not the satisfactions of the intensity rosa(Pd,A Vl,ta) 
associated with the activity A VI. Pd cannot achieve his/her important goal situation Sz ' (case v) means: Pd has not 

680 and will not have the satisfactions associated with achieving the goal Sz and, additional, Pd perceives the negative 
stimuli connected with not achieving the goal Sz. 

When Pd is separated, for a long time, from an object or situation that he/she loves then Pd must not be sad. 
Only when his/her state of emotions is not good, i.e. if tmku(Pa\ta) < ck <0, then Pd'xs sad, where 
unku(Pdta) = S i4iKB zful(Pd,b,ta) (sugg : ck = -8). On the basis of these observations, we define: Pd is sad with 

685 respect to OSA, at time ta, if unku(Pd,ta) < ck and one of the following conditions traul, trau2, trau3 hold: 
trau 1 . Pd is aware that he/she is separated from OSA, in degree 0<gtr< 1.5 for a time tr > ctl, and 
rosa(Pd, OSA, ta) > cwl, where 0.4 < gtr < 1 \fPd is only in letter communication with person OSA, 0<gtr< 0.6 if 
Pd communicates with OSA also by telephone, gtr =1.5 if person OSA is dead. 
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trcm2 . Pd is aware, at time ta, that he/she is in a grave situation, Sw, such that rosa(Pd,Sw,ta) < ~cwl, and will be in 
690 this situation for a time tr>ctl. 

tr<ru3 . Pd is aware, at time ta, that he/she cannot achieve his/her goal situation Sz and for the whole stimulus, 
grnz(PdSz,ta), associated with this feet holds grnz(Pd,Sz,ta) < -cwl. 

The intensity of sadness of Pd with respect to OSA, in case traul, at time ta: 
traurl(Pd,OSA,ta) = lnj(tr) * gtr* (ctrl * rosa(Pd,OSA,ta) - unku(Pd,ta) - cwl * ctrl + ck) 
695 where Injftr) =ln(l-ctl+tr) if ctl< tr <30 years, lnj(tr)= ln(31-ctl) if tr >30 years, 0.K ctrl <1 (sugg.: ctrl=0,5). 
The intensity of sadness of Pd with respect to situation Sw, in case trau2, at time ta: 

traur2(Pd,Sw,1a) = - Inj(tr)* (ctrl * rosa(Pd,Sw,ta) + unku(Pd,ta) + cwl * ctrl - ck). 

The intensity of sadness of Pd when goal situation Sz has not been achieved (case trau3). First we define the 
function grnz(Pd,Sz,ta). Because Pd does not achieve the goal situation Sz, he/she does not perceive the following 
700 expected (positive) stimulus of Sz: 

rerz(Pd,Sz,ta) = rosa(PdSz.ta) + epr(Pd,SzJsp,b,a,ta) - enr(PdSzJsn,b,a,ta) 
where: fsp denotes epb, upb, epbu, upbu, vnb and vpb, epr(Pd,SzJsp,b,a,ta) is defined in Sect. 2.3.1, 

Bzl = {beWB\ fdser'; (...fsp(Pd\b) =...)) is attached to the situation Sz in the list LZS }, 
Bz2 - {be WB | (dser\ (...fsn(Pd,b) =...)) is attached to the situation Sz in the list LZS }, 
705 fsn denotes enb, unb, enbu, unbu, vnb and vpb, enr(Pd,SzJsp,b,a,ta) is defined in Sect. 2.3.2. Additional, the 
situation 'the goal Sz has not been or will not be achieved' causes the stimulus (in most cases negative): 

rnez(PdSz,ta) = epr(Pd,SzJsp,b,a,ta) - 2^ enr(PdSzJsn,b,a,ta) 
where Bz3 = {be WB | fdsne'; (...fsp(Pd,b) =..)) is attached to situation Sz in the list LZS}, 

Bz4 ={beWB\ (dsne ; (...fsn(Pd,b) =...)) is attached to situation Sz in the list LZS}. 
710 The whole decrease of satisfactions arising from not achieving goal situation Sz equals: 
grnz(Pd,Sz,ta) = - rerz(PdSz,ta) + rnez(Pd,Sz,ta). 
The intensity of sadness of Pd when he/she has not achieved goal situation Sz (case trau3) equals: 

traur3(Pd,Sz,ta) = - ctrl* grnz(Pd,Sz,ta) - imku(Pd,ta) - cwl * ctrl + ck. 
Positive and negative feelings to OSA . Pd has positive emotions to OSA, at time ta, if zulieb(Pd,OSA,ta) > 0. The 
715 intensity of these emotions to OSA equals zulieb(Pd,OSA,ta). Pd has negative emotions to OSA, at time ta, if 
abhas(Pd,OSA,ta) > 0. The intensity of these emotions to OSA equals abhas(PdOSA,ta). 

Dislike . Pd dislikes OSA, at time ta, if abhas(Pd,OSA,ta) - 1.2* zulieb(Pd,OSA,ta) >1. The intensity of this dislike: 
abn(Pd,OSA,ta) = abhas(Pd,OSA,ta) - 1.2* zulieb(PdOSA,ta) - 1. 
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Annoyance . Let OS denotes an object or a situation. Pd is annoyed at/with OS, at time to, when 1< abhas(Pd,OS,ta) 
720 < car and Pd thinks - believes - that he/she can perform activities A Val,...,A Vak which will prevent OS from 

decreasing bef(Pd,b,.) in nature, where be Bd(Pd) and car is a constant. The intensity of this annoyance equals 
abhas(Pd,OS,ta) - 1. 

Anger. Pd has anger at/with OS, at time ta, when abhas(Pd,OS,ta) > 0.85 * car and Pd thinks - believes - that 

he/she can perform activities A Vzl A Vzk which will prevent OS from decreasing bef(Pd, b,.) in future, where be 

725 BdfPd). The intensity of this anger equals abhas(Pa\OS,1a) - I. 

Hate . Pd hates OSA, at time ta, if abhas(Pd,OSA,ta) > 2.5 and des(Pd,bvr(OSA),ta) > 2 (bvr(OSA) - the need for 
retaliation and revenge on OSA, s. Sect. 5). The intensity of this hate, at time ta, equals 
has(Pd,OSA,ta)=des(Pd,bvr(OSA),ta) * abhas(Pd,OSA,ta) - 5. 

6.2. Fear 

730 Pd feels fear when he/she is in one of the following situations furl fur3.1: 

furl. Fear of a situation or an object: Pd perceives situation Sf or object Of in the situation Sf such that: 
i. rosa(Pd r Sfta) <-0.2 * cwl and Pd is, will or can be in the situation Sf; 

ii Pd believes that he/she can perform only activity A Vf (e.g. do nothing' ) which might, with probability pv <0. 95, 
extricate Pd from the situation Sf. 
735 Example 6.1. The virtual boy vJl in the entertainment software ESJ (s. Example 2.7, Sect. 2.2) is humiliated by the 
virtual boy vjg, when they meet (situation Sg). vJl fears vjg and tries to avoid him. This behavior, Vv, is effective 
only in 20 % (pvj = 0.2). It holds rosa(vJl,Sg,ta) < -20. 

fur J. J. Fear of a decrease of bef(Pd,b,.) {be WB): Pd believes (or perceives) that bef(Pd,b,ta) will decrease by fy(b) 
> 5 in time (tl,t2) (tl > to). Pd thinks that he/she can perform only activity AVf which would prevent the decrease 

740 of beffPd, b, ta), only with probability pv < 0. 95. 

Example 6.2. vP is the virtual person in the entertainment software ES (s. Example 2.4, Sect. 2.2). Virtual physician 
told vP that he/she has cancer, i.e. the values of bef(vP,GE,ta) and bef(vP,LE,ta) will probable decrease according 
to the patterns enbfvP.GE) and enb(vP,LE) given in Example 2.4. vP fears these decreases of bef and believes that 
only the behavior, Vds, I will do what the virtual doctor vAKs prescribes' (s. Example 2.6) can partially prevent 

745 these bef decreases, with probability pkv = 0.3. 

fur2. Fear of separation from an object or a situation (OSl): rosa(Pd,OSl,ta) > 0.2 * cwl and Pd perceives or 
believes (time to) that he/she can be compelled to separate from OSl, in degree 0<gtr<1.5, with probability ptr, 
for a time tr > ctl. 
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fur3. Fear of performing an activity not right or of not achieving goal situation: 
750 i. Let Sz2 be a goal situation of Pd, where rosa(Pd,Sz2,ta) > 0.2 * cwl. Pd is in a situation SI and believes that 
he/she could achieve situation Sz2 when he/she would execute activity A VI 2; 

ii. However, Pd believes that when he/she would execute the activity ^41^/2 then he/she could achieve, with 
probability pi 2 > 0. 1, an undesirable situation in SF instead of the goal situation Sz2 (e.g. if Pd executes A VI 2 
wrong or A VI 2 is not suitable for achieving Sz2), where rosa(Pd,Sf2,ta) < rl2 <0.95* rosa(Pd,Sz2,ta) for Sf2 <= SF. 

755 Example 6.3. The virtual skier vPm appearing in the entertainment software ESI (s. Example 2 2, Sect 2.2) stands 
at the top of a steep piste. He never skid over such difficult piste. When he would run well to the bottom of the piste 
(behavior Vsf) then he would achieve his goal situation, Sgf, I've run well (by ski) to the bottom of the piste and 
I'm happy' . When vPm would not run well and fall down then he can be in one of the 3 situations: Sgu - I've fallen 
down but I can continue skiing", . Ssu - I've fallen down and have pain in the knee, I can't continue skiing but I can 

760 walk', Ssv - I've fallen down, I'm serious hurt and I can't walk' . vPm thinks (at time to) that the probability of 
achieving the situation Ssu or Ssv equals psg = 0.2. It holds rosa(vPm,Ssv,ta) < 1.8* rosa(vPm,Ssu,ta) < -60 and 
rosa(vPm,Sgu,ia) > -10. 

fur3.1. A special case of fur 3: Pd achieves either the goal situation Sz2 or only one undesirable situation S/2 (thus 
SF= {S/2}). In this case, the condition (ii) in fur3 reads as follows: 
765 ii" . Pd believes that when he/she executes activity A VI 2 then he/she will achieve the undesirable situation S/2, with 
probability pi 2, and the goal situation Sz2 with probability 1 -pi 2. 

Example 6.4. vPt is a virtual technician in an entertainment software ESl. He is unemployed since 10 months and 
could not achieve his goal situation, Sah, "have a job according to my qualifications' . He applied many times for a 
job (behavior Vbew) but received only negative answers (situation Scar - 'continuation of his unemployment " ). His 

770 hope (pd) of getting a job decreased from 0.95 (before 10 months) to 0.3 now (time ta), i.e. vPt believes that, with 
probability 1 - pa = 0.7, also the next answers to his applications will be negative vPt fears these negative answers - 
he is in fear of the situation Sar and he fears that he does not achieve his goal Sz2 by the behavior Vbew . 

furl. 1 is a special case of furl because every decrease of be/(Pd,b,.) can be considered as a situation Sf 'm 
which the pattern (ds;...fsn(Pd,b) = ...) occurs which describes this decrease of bef(Pd,b,.). Therefore, we give the 

775 intensity of fear only for cases furl, fur2, fur 3 and fur 3. 1. 
The intensity of the fear described in furl- 
(6.1) furh(Pd,S/AVfta) = - (1 - py)* rosa(Pd,Sf2,ta). 

In Example 6. 1, the boy vjl fears the situation Sg (to meet the boy vjg). The intensity of this fear equals 
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furh(vJl,Sg, Vv.ta) - - (1 - pvj)* rosa(vJl,Sg,ta). In Example 6.2, vP fears the situation, Skk, have cancer . The 

780 intensity of this fear equals furh(vP,Skk, Vas,ta) = -(] -pkv) * rosa(vP,Skk,ta). 

In order to define the intensity of the fear described in fur2, we must notice the following: Pd thinks (at time 
ta) that he/she will be in situations Slj, in time (ta,ta+tr),j =l,...,k, such that: (i) Pd has a situation model SMIj of the 
situation Slj, where SMlj differs from SMlr for j* r, (ii) when Pd is in situation Slj (at time tj, ta< tj< ta+tr) and is 
separated from OSl in degree gtr then rosa(Pd,OSl,tj) > 0.2* cwl, for j=l,...,k. If Pd does not imagine such 

785 situations then k=0. Let Sljl,...,Sljm are the situations which have the greatest values rosa(PdOSl,tje) (where /n<5), 
i.e. rosa(Pd,OSI,ti) < min(rosa(Pd,OSl,tje), 1< e< m) for / * je and e < m. The intensity of the fear of separation 
from OSl when Pd imagines that he/she would be in situations Sll,...,Slk after the separation, equals: 
(6.2) furv(Pd,OSl,ta) = ptr* gtr*(rosa(Pd,OSl,ta) + rosa(Pd,OSl,tjl) +...+ rosa(Pd,OSl,tjm)). 

The intensity of the fear described in fur 3. 

790 (6.3) cmgs(Pd,SF,AV12,ta)>pI2*(rosa(Pd,Sz2,ta)-rI2). 
The intensity of the fear described in fur 3.1: 

(6.4) angs(Pd,SF,A V12,ta) = pl2 *(rosa(Pd,Sz2,ta) - rosa(Pd y Sf2,ta)). 

In Example 6.3, the skier vPm fears the situations Ssu and 5sv. The intensity of this fear equals 
angs(vPm, {Ssu, Ssv}, Vsfja) >0.2 *(rosa(vPm,Sgf,ta) - rosa(vPm,Ssu,ta)). In Example 6.4, vPt fears the situation 
795 Sar (negative answers to his applications). The intensity of this fear equals angs(vPt,Sar, Vbew,ta) = 0. 7* 
(rosa(\Pt,Sah,ta) - rosa(vPt,Sar,ta)). 

7. Envy, Jealousy, Shame and Feeling Guilt 

7.1. Envy 

A success or a property of a human, PI, can be the envy of another human, Pm. A success of PI means an 
800 increase of beffPJ.bl,.) for at least one */. A property of PI arises envy of Pm when Pm thinks that bef(Pl,b2,.) 

should be smaller, where b2 is associated with this property. Thus, we may define envy more precisely as follows: A 
human Pm envies human PI his/her success or property, at time ta, when Pm believes that: 
- bfm(Pl,b,ta) > cn(b) + bef(Pm,b,ta), for at least one be Bd(Pm), where Pm thinks that the value bef(Pl,b,ta) 
equals bfm(Pl,b,ta) and cn(b) > 0, 
805 - Pm thinks that PI has no right to such great value bfm(PI,b, ta). 
With this envy of Pm is connected the following need of Pm : 

bnd(b) - PI should have such value bfm(Pl,b,t) that bfm(Pl,b,t) < cn(b) + bef(Pm,b,t), for * > ta. The intensity of 
the envy of Pm at the value bfm(Pl,b,ta) is described by bef(Pm,bnd(b),ta) and des(Pm,bnd(b),ta) as follows: 
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bef(Pm,bnd(b),ta) = min(bef(Pm,b,ta) + cn(b) - bfm(Pl,b,ta) + 15, 15), 
810 des(Pm,bnd(b),ta) = max(chl*(bfm(Pl,b,ta) - cn(h) - bef(Pm,b,ta)), 0), 

where 1 < chl < 2 (sugg. : chl = 1. 4). 

7.2. Jealousy 

A human or a mammal, Pd, is jealous of an object, Of, when Pd believes that he/she must share his/her kind 
feeling, friendship or love for a human or a mammal, Pdl, with the object Of, or he/she is losing the positive 
8 1 5 emotions of Pdl towards Pd because of the positive feeling of Pdl towards the object Of. Pd and Pdl may be agent 
systems if they simulate emotions. We defined the intensity of friendship and love of Pd towards an object Ob as 
zulieb(Pd,Ob,ta). By this function we define jealousy more precisely as follows. Pd is jealous of an object, Of, (at 
time ta) because of kind feeling, friendship or love of Pdl towards Of when: 

- zulieb(Pd,Pdl,ta) > 1 and Pd believes that zuIiew(Pdl ,Pd,ta) has decreased or is going to be decreased because 
820 zuliew(Pdl,Of,ta) is too great or is going to be too great, where zuliew(Pdl,Pd,ta) and zuliew(Pd 1 ,Of,ta) are the 

values zulieb(PdI,Pd,ta) and zulieb(Pdl,Of,ta), respectively, as they are perceived by Pd, 

- Pd does not accept the positive feelings of Pdl towards Of i .e Pd does not accept the intensity zidiew(Pdl ,Of,ta) 
and the perceived or expected decrease of zuliew(Pdl,Pd,ta), in degree 0 < anl(Pdl,Ofta) < I. 

With this jealousy of Pd is connected the following need of Pd. 
825 beif(Oj) - decrease zuliew(Pdl,Of,ta). The intensity of this jealousy is given by 

bef(Pd,beif(Of),t) = max(-22, 6 - sqrt(sqrt(zuliew(Pdl,Of,ta)* zulieb(Pd,Pdl,ta)* 0.5))* anl(Pdl,Ofta)) 
des(Pd,beif(Of),t) = min(55, chl *(6 - bef(Pd,beif(Of),t))). 

7.3. Shame and Feeling Guilt 

Let NG denotes the set of norms and rules of Pd or the community to which Pd belongs. For example, some 
830 goals and ethical principles which Pd fixed for himself We assume that Pd accepts the norms and rules in NG and 
has needs, bnr(uNe), to fulfil the norms and rules in uNe NG, where the sum of subsets uNe equals NG and 
uNe n uNj = 0. The need bnr(uNe) is a special case of the need AN (recognition, acknowledgment and self-esteem) 
Thus, if Pd does not fulfil some norms in NG then bef(Pd,AN,.) and zful(Pd,AN,.) decrease. 
Shame . Pd has shame (at time ta) when. 
835 i. Pd has violated some norms or rules in NG, or Pd could not fulfil some norms or rules in NG (e.g. Pd has been 
forced to do something against these norms and rules); 

ii. because of (i), zful(Pd,AN,ta) decreased by dzffAN) >1; 

iii. Pd cannot perform any activity which would increase zful(Pd,AN,ta) by dsl(AN) > 0.4* dzf(AN). 
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The intensity of this shame is given by: 
840 sha(Pd,ta) := sha(Pa\ta) + dzf((AN). 

The initial value afsha(Pd,.) equals 0. When zful(Pd,AN,t) increases by df(AN) > 0.4 then sha(Pd„) decreases: 
sha(Pd,t) := sha(Pd,t) - csl * df((AN) 

where 0<csl < I (sugg. csV = 0. 7). However, A/ has in his/her memory the situation, Sh, which caused the shame. 

When Pd imagines the situation Sh (at time // > to + / day) then Pd feels again the shame connected with the 
845 situation Sh. The intensity of this shame equals cs2* sha(Pd,ta) where 0 < cs2 < J and cs2 expresses the intensity of 

the imagination of the situation Sh. 

Feeling guilt . There are several opinions about what emotion is feeling guilty (s. Izard [IZA], (1994)). The definition 
given below reflects the basic ideas of these opinions. Let PO denotes God, deity, ghost, human, animal, a group of 
persons or animals (e.g. a community), organization, institution; PO can be also Pd. 
850 Pd feels guilty with regard to PO, at time to, when: 

i. Pd performed activities A Vsl,...,A Vsu (in time (ta-vt-wt, ta-vt), where vt > 0, wt > 0) which did damage to PO 
(e.g. injured PO) although Pd could perform other activities which had done only little or no damage to PO; 

ii. Pd is conscious (at time to) that: (a) he/she failed - he/she violated some norms or rules in NG - when performing 
the activities A Vsi, i=l «, (b) he/she has positive feelings towards PO. 

855 This description we state more precisely: Pd feels guilty with regard to PO, at time to, when: 

si. Pd performed activities A VsI,...,AVsu (in time (ta-vt-wt, ta-vt), where vt > 0, wt >0) which did damage to PO - 
Pd is aware (at time to) that he/she decreased bef(PO,b,ta-vt-wt) by dos(b) for be Bo; if Pd had performed these 
activities in a better way or instead of A Vsi had performed other activities, then Pd would have done only little or no 
damage to PO; 

860 s2. Pd is conscious (perceives, at time to) that.' (a) because of his/her activities A Vsi, i"= /,..., u, and his/her failure (in 
the time fto-vMKto-w;), zful(Pd,AN,ta) decreased by dfv(AN), (b) zulieb(Pa\PO,ta) - abhas(Pd,PO,ta) > 0.2. 
The intensity of feeling guilt with regard to PO, at time to, equals: 

shuld(Pd,PO,ta) = (zulieb(Pd,PO,ta) - abhas(Pd,PO,ta)) * dfv(AN)* sqrt(scha(PO)) 
where scha(PO) = dos(b) 
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Claims to 

Representation of Emotions in Electronic Devices 
Schurmann Alfred 

Claim 1. Representation of stimulus patterns in descriptions of objects, situations and activities The form of said 
5 stimulus patterns. The method for determining intensity of expected satisfaction (bef(Pd,b,ta+i*q)) and expected 
desire (des(Pd,b,ta+i*q) ), with respect to a need b, by these stimulus patterns. The use of said stimulus patterns to: 

* determination of intensity of expected stimulus of an object, of a situation or of an activity (OSA); 

* representation of intensities of the emotions contentment, joy, happiness, dissatisfaction, annoyance, anger, 
grief, pain and suffering; 

10 * representation of intensity of expected contentment and joy when achieving of a goal is realized; 

* representation of intensity of dissatisfaction, disappointment and anger when obstacles make difficult to realize 
achieving a goal (a goal situation) or when a goal has not been achieved; 

* representation of intensities of positive emotions (liking, friendship, affection, love) and negative emotions 
(dislike, annoyance, anger, hate) to/for an object, a situation or an activity OSA; 

15 * representation of intensities of the emotions: desire for retaliation and revenge, frustration, depression, sadness, 
fear, hate, envy, jealousy, shame and feeling guilt. 
Claim 2 The method for representing intensities of the emotions (with respect to a need b): contentment, joy, 
happiness, dissatisfaction, annoyance, anger, grief, pain and suffering - it includes: 

* the intensities of these feelings of Pd (at time /) are given by function values (e g by zful(Pd,b,t) ), where Pd 

20 denotes a human, a mammal, a virtual human or mammal in a software system, or an agent system (e.g. a robot); 

* the intensities of said emotions change when: (i) Pd perceives values of satisfactions (bef(Pd,b,ta)) and desires 
(des(Pd,b,ta)) by senses or sensors, (ii) Pd perceives an object, a situation, or an activity (OSA), (iii) Pd perceives 
that he/she is achieving his/her goal situation or that he/she cannot achieve the goal situation, 

* said, in Claim 1, stimulus patterns are associated with a goal situation, in the list of current goals; 
25 * representation of intensity of contentment and joy when Pd realizes achieving a goal; 

* representation of intensity of dissatisfaction, disappointment and anger when obstacles make difficult to 
realize achieving of a goal situation or of an intermediate goal, or when Pdhas not achieved his/her goal. 

Claim 3. The method for representing intensities of positive emotions (liking, friendship, affection, love) (e.g. by 
zulieb(Pd,OSA,l)) and negative emotions (dislike, annoyance, anger) (e.g. by abhas(Pd,OSA,t)) to/for an object, a 
30 situation or an activity (OSA) - it includes: 
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* the intensities of said emotions are determined by said, in Claim 1 and 2, intensities of satisfaction (bef(Pd,b,t)) 
and desire (des(Pd,b,t)), 

* the intensities of said emotions change when Pd perceives that: (i) said OSA caused, supported or prevented an 
increase or decrease of intensities of satisfaction (bef(Pd,b,t) ) or desire (des(Pd,b,t) ); (ii) OSA realized, 

35 supported or prevented achieving a goal (a goal situation). 

Claim 4. The method for representing intensity of desire for retaliation and revenge on an object (Ob) - it includes: 

* said intensity of desire for retaliation and revenge change when said, in Claim 3, intensities of negative or 
positive emotions to/for said Ob increase or decrease; 

* the intensity of said feeling is determined by said, in Claim 3, intensity of negative emotions to said Ob. 
40 Claim 5. The method for representing intensities of the emotions frustration and depression - it includes: 

* intensities of said emotions are determined by: (i) said, in Claim 2, intensities of contentment, joy, happiness, 
dissatisfaction, annoyance, anger, grief, pain and suffering; (ii) said, in Claim 1, intensity of stimulus of an 
object, of a situation or of an activity, OSA. 

Claim 6. The method for representing intensity of hate to an object Ob - it includes: 
45 * said intensity of hate is determined by: (i) said, in Claim 3, intensity of negative emotions (e g by abhas(Pd,Ob,t) 
) to/for said Ob; (ii) said, in Claim 4, intensity of desire for retaliation and revenge on said object Ob. 
Claim 7. The method for representing intensity of sadness - it includes: 

* said intensity of sadness is determined by: (i) said, in Claim 2, intensities of contentment, joy, happiness, 
dissatisfaction, annoyance, anger, grief, pain and suffering; (ii) said, in Claim 1, intensity of stimulus of an 

50 object, of a situation or of an activity, OSA. 

Claim 8. The method for representing the intensity of fear - it includes: 

* said intensity of fear is determined by said, in Claim 1 , intensity of stimulus of an object, of a situation or of an 
activity, OSA. 

Claim 9. The method for representing the intensity of envy - it includes: 
55 * said intensity of envy is determined by said, in Claim 1 and 2, intensity of satisfaction (bef(Pd,b,t)) or desire 
(des(Pd,b,t)). 

Claim 10. The method for representing the intensity of jealousy - it includes: 

* said intensity of jealousy is determined by said, in Claim 3, intensities of the feelings liking, sympathy, friendship 
and love to/for an object Ob (e.g. by zulieb(Pd,Ob.t)). 

60 Claim 11. The method for representing the intensity of shame - it includes: 
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* said intensity of shame is determined by said, in Claim 2, intensity of the emotions dissatisfaction, annoyance, 
anger, grief, pain and suffering (e.g. by zful(Pd,AN,t)), with respect to the need {AN) for recognition, 
acknowledgment and self-esteem' . 
Claim 12. The method for representing the intensity of feeling guilt - it includes: 
65 * said intensity of feeling guilt is determined by: (i) said, in Claim 2, intensity of the emotions dissatisfaction, 
annoyance, anger, grief, pain and suffering (e g by zfuI(Pd,AN,t)\ with respect to the need {AN) Tor 
recognition, acknowledgment and self-esteem"; (ii) said, in Claim 3, intensities of positive emotions (e.g. 
zulib(Pd,PO,t)) and negative emotions (e.g. abhas(Pd,PO,t)) towards an object PO; (iii) said, in Claim 1 and 2, 
69 intensity of satisfaction {bef(Pd,b,t)) or desire {des(Pd,b,t) ). 
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Abstract of 

Representation of Emotions in Electronic Devices 
Schurmann Alfred 

A new, formal representation of emotion states in electronic devices (e g in software systems and mobile 
agent systems) is described. This emotion representation is based on the notions: intensities of satisfaction and 
desire, for a need. This representation enables good simulation of emotions in entertainment software and (mobile) 
agent systems. 

There are given conditions for changes of intensities of main emotions, based on the notions satisfaction 
and desire, and the given stimulus patterns. Let OSA be a description (a model) of an object, of a situation or of an 
activity. Intensities of the following emotions are determined by formulae: 

- contentment, joy, happiness, dissatisfaction, annoyance, grief, anger, sadness, pain and suffering; 

- positive emotions (liking, affection, love) and negative ones (dislike, annoyance, anger) to/for OSA, 

- satisfaction and joy when a goal (i e goal situation) is achieved; dissatisfaction, annoyance and disappointment 

when a goal situation is not achieved; 

- desire for retaliation and revenge, hate to an object; 

- frustration, depression, sadness, envy, jealousy, shame and feeling guilt. 
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Each person, concern, or organization to which I have assigned, granted, conveyed, or licensed or am under an 
obligation under contract or law to assign, grant, convey, or license any rights in the invention is listed below: 

g] No such person, concern, or organization exists. 

□ Each such person, concern, or organization is listed below. 



Separate statements are required from each named person, concern, or organization having rights to the invention 
stating their status as small entities. (37 CFR 1 .27) 

I acknowledge the duty to file, in this application or patent, notification of any change in status resulting in loss of 
entitlement to small entity status prior to paying, or at the time of paying, the earliest ^e ^ue^or any 
maintenance fee due after the date on which status as a small entity is no longer appropriate. (37 CFR 1 .28(D)) 



^Jiid^mc£r a/7/? NAME OF INVENTOR NAME OF INVENTOR 

/K ^e^p^?^^^*^ . — — — 

Signature of inventor Signature of inventor Signature of .nventor 



DC 20231. 



(July 1998) 



